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ABSTRACT 

The Georgia Television Evaluation Prpjec^ 
designed to provide: a model to evaluate the production 
effectiveness of an ETV series; a model for the developn 
instruments and data-gathering procedures^ statistical 
analyzing and interpreting data^ a field test of all pre 
instruments and data-gathering procedvires^ a model for 
evaluation of the GETV Network after the initial assessijient studies 
have been completed, an estimate of cost factors and peirsonnel 
requirements for operating an evaluation system, a mode!, for the 
evcluation of the total impact of Instructional Televis:Lon, and a 
model for evaluating the total impact of the Public Broadcasting 
segment of Educational Television. In Volume i the activities 
directly involved with developing the evaluation model Ltself are 
described* After the problem area, purposes, and charac :eristics of 
the network are specified in the first chapter, a brief overview of 
the research literature is presented* This summary is followed in 
Chapter Three by an overview of the research and evaluai:ion 
activities. The model itself appears in the fourth chap1:er. Chapter 
Five contains recommendations resulting from feasibility studies. The 
volume concludes with a summary and suggestions for future research. 
(For related documents, see TM 002 622-635. ) (Author/KM)] 
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PREFACE 



Data from many sources and people were input into the present pro- 
ject. As opposed to the usual deductive "research" activity the present 
project employed inductions. In addition, ihe results should perhaps be 
considered specific to the state of nature 'in the State ^of Georgia. Surely 
the strategies, methodologies and softwarTarT'sugg ^ ^ ol iiiaiiv direc- 
tions that efforts aimed at evaluating educational television might take, 
but our specific conclusions are data tied. Formal ijypotheses were not 



gathering. It is 



the. Executive Direc- 



Clliott, Coordinator 



tested, and feasibility significantly influenced data 

hoped that despite many constraints and practical problems the resulting 
model and selected data will meet with acceptance. 

Many individuals were influential in the completion of the project. 
At Georgia Educational Television, Richard Ottinger, 

tor, together with 0. Max Wilson, Clara W. Howell ancj Olan Cosper really 
got us off the ground by providing ideas, research le^ds and access to " 
school personnel. Russell Clark, Director, and Jess 
of Evaluation, of the Division of Planning, Research ^nd Evaluation of the 

Department of Education, in addition to monitoring the progi<ess of the 

1 I 

project provided technical advice. At the University *pf Georgia, Jerry 
Ayers and Peter Rowe provided invaluable assistance bojth in regard to 
ideas and actual implementation and operation. Many secretaries in the 
"Baldwin Fourth Floor" pool provided invaluable assista'nce and exhibited 
great patience. In particular Norma Faye Garrett, Barbira ^ilver, Peggy 
Nix, and June McClain should be singled for praise. Two\ graduate 
students from the School of Journalism, Annette WilkinsoA and Chuck Thorp, 
did a great deal of the really hard work: interviewing, Haunting the halls 



of the library, etc. Many technical consultants were employed. From 
the Childrens Television Workshop - Edward Palmer and from Michigan 
State University - Bill Farquhar. \ 

The greatest thanks of all must of course go to the adminis-diators, 
teachers, and students of Georgia's public schools. They gave urielf- 
ishly of the^r time^nd energy and really ceserve the credit for^ hat- 
ever IS "good" about the project, modeT," ^sults and reports. 
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Chapter 1 



INTRODUCTION AND SPECIFICATION OF THE PROBLEM 
NATURE OF THE PROBLEM 

It has long been acknowledged that instructional television will never 
replace the teacher. It is now becoming increasingly apparent that the 
teacher will never replace instructional television. The case for ITV has 
"nor*aiWdys-%e€R^o-s^ng* or clear (Palmer, 1970). In the early dayroF 
ITV efficiency in terms of reaching large numbers of students was the major 
justification for its existence. Since those days, however, we have in- 
creased enormously our knowledge of how to "use" the medium. We have 
learned to increase that participation, involvement and completion evident 
in what McLuhan terms the "cool medium" (McLuhan, 195U). There are some 
tasks and activities that can best be handled by ITV rather than through 
the application of traditional classroom methodologies. A brief list of 
some of the advantages of ITV suggested by Henderson (1957) support this 
point : 



ITV can 



• . . make available exemplary teaching to large numbers of 
students and teachers. 

... supplement offerings of small schools with limited budgets 
or available talent. 

... allow for more efficient use of facilities by its appli- 
cation in large class instruction. 

• . . vitalize the teaching-learning process by bringing home 
the immediacy of a concept or event by giving each student 
a "front row seat^ " particularly with live broadcasts* 

... make available to all expensive, inaccessible and difficult 
to replicate experiments or demonstrations. 

••• provide uniform and standardized educational experiences 
with a single tape broadcast into may classrooms. 



There are, in addition, other technical ways in which television through 
the use of tape outstrips one of its chief competitors, film. 

There are, of course, some distinct disadvantages to the use of ITV. 



ITV cannot 



.... be well adapted to individualized instruction in its 
present state of development. 

... be as flexible in schedu.M4ig...and^timing of learning 

experiences as might be desirable. ~ ~ ~ " 

... inlure as much student participation as might be best 
for learning. 

... be as flexible relative to choice of content and goals 
by virtue of the standardization and control (to some 
extent) of curricula. 

In the final analysis, however, a well conceived and implemented tele- 
lesson and series provides benefits which far outweigh the debits. But how 
effective is educational television in the State of Georgia? 

SPECIFIC PURPOSES OF PROJECT 

The specific tasks of the project were for the most part set forth in 
the contract between the Georgia Department of Education and the University 
of Georgia. Project activities were monitored by the GDE Division of Plan- 
ning, Research, and Evaluation. The following list of tasks are in approxi- 
mate order of effort and importance as viewed by the project staff. The 
Georgia Television Evaluation Project was to provide: 

1. A model to evaluate the production and effectiveness of an ETV 
series. 

2. A model for the development of instruments and data gathering 
procedures . * * 

3. Statistical designs for analyzing and interpreting data. 
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t. A field i:est of all prototype instruments and data gathering 
procedures . 

5. A model for continuous evaluation of .the GETV Network after the 
initial assessment studies have been completed. 

6. An estimate of cost factors and personnel requirements for 
operating an evaluation system. 

7. A model for the evaluation of the total impact of Instructional 
Television. 

^- A.J^P^J?'' evaluating the total impact of the Public Broad- 
casting sepeBt-ofHE dtioationa l-^iej^-sioiT: 

This effort is not a research exercise in the usual sense of 
employing elaborate sampling procedures, complex statistical design and 
analysis procedures. It is an exploratory and development effort aimed 
at outlining the major dimensions of a statewide educational television 
evaluation. 



NEED FOR THE PROJECT 

How effective is television as an educational medium? The need for 
the present project is predicated on the lack of (1) available hard data 
to assist in making the multitude of decisions about the operation and 
effectiveness of Georgia Educational Television, and (2) any long term 
and continuous data gathering design. It would perhaps be imprudent to 
approach educational television evaluation with the question, "Is it 
good or bad?" Under well defined conditions with certain kinds of 
students viewing in particular schools or homes with selected 
teachers and administrators it is both good and bad. This is not to 
beg the question, but merely to point out that it is impossible to 
specify the universe of situations where television may be employed. 
The more important question is, "Is educational television effective?" 



It was the intent of this project to develop a model and methodology that 
might answer such a question. 

As used in this report the term evaluation refers to the systematic 
use of data gathered through formal means to make value judgements 
(Stufflebeam, 1968). With regard to the pre ■ n ■■ -ct we are concerned 
with developing methodologies for the collection , organization , analysis 
and reporting of information bearing on the effectiveness of the education 
al television network in the state of Georgia. The kinds of decisions to 
be generally made are the following: 

(1) Planning - Specification of the domain, major goals and 

specific objectives to be served 

(2) Programming - Specification of procedures, personnel, facilities 

budget and time requirements 

(3) Implementing- Specification of activities related to directing - 

programmed activities 

(4) Recycling - Specification of data related to terminating, 

continuing, evaluating or drastically modifying 
activities 

It is intended that ultimately a model can be provided which will 
economically yield data useful in making the above four types of decisions, 

GENERAL OBJECTIVES OF GEORGIA EDUCATIONAL TELEVISION 

In order to evaluate the effectiveness of a television network, infor- 
mation regarding intent, goals, and objectives is needed. Unfortunately, 
these data were not available until toward the close of the project. They 
nevertheless provided some guidance. An abbreviated listing of the major 
objectives of GETV grouped into four broad categories follows. 

Influence the Intellectual and Personal-Social 
Growth, Development, and Learning of Students 



GETV will: 



1. Provide effective modern foreign language instruction 
\ F ovide effective physical education instruction 

'J^ovide effective relevant instructional music programs 
^. Provide effective early childhood education programs 

5. Provide effective relevant mathematics education programs 

6. Provide effective relevant science instruction 

7. Provide effective relevant social studies instruction 

8. Provide effective relevant language arts instruction 

9. Provide selected programming adaptable for use by special educational 
groups (e.g. gifted, slow- learners, etc.) 

10. Provide selected programming aimed at developing appropriate personal- 
social skills 



Significantly influence the Knowledges 
and Instructional Skills of Teachers 



GETV will: 



11. Provide effective in-service education for teachers in modern mathematics 

12. Provide effective in-service education for teachers in the language arts 

13. Provide effective in-service education for teachers in the physical and 
biological sciences 

14. Provide effective in-service education for teachers in the social sciences 

Significantly Influence the Maximum Utilization 
of Educational Television Broadcasts 

GETV will: 

15. Provide adequate administrative and production facilities 

16. Provide adequate signal to all schools 

17. Provide teacher with appropriate schedule information and teaching aids 

18. Provide assistance to local schools and teachers in developing experi- 
mental programs and implementing CCTV. 

19. Provide assistance to teachers, curriculum directors, supervisors, and 
administrators in effecting maximum utilization of series and individual 
telelessons 

20* Assist colleges and universities in integrating ETV utilization -skills 
in their teacher training programs 

Significantly Influence the Educational, Cultural, and 
Recreational Awareness of the General Adult Population 

GETV will: 

21. Provide public affairs telecasts 

22. Provide cultural enrichment telecasts 

23. Provide educational programming aimed at particular sub-audiences 
(e.g. adult illiterates, specialized avocational interest groups, 
school drop-outs, vocational training and retraining, agriculture, 
etc. ) 



2^. Provide an efficient communication system adaptable for Cil/il 
Defense purposes. 

It is obvious that objectives for a television network cannot remain 
static. Society and its needs are ever-changing. Therefore the objectives 
must change. A good example of how society's changing needs are dictating 
a revamping of educational requirements is documented in the recently 
published Goals for Education in Georgia - a report of the Advisory 
Commission of Educational Goals (Advisory Commission, Georgia Department 
of Education, 1969). 

How have these objectives been implemented? To gain some perspective 
on the nature and extent of educational television services in the state 
of Georgia a brief description of the development of the systeirt^Will be 
presented in the following section, and in the section following that a 
verbal picture of the network today. 

DEVELOPMENT OF GEORGIA EDUCATIONAL TELEVISION SERVICEjl 

Perhaps the most succinct approach to a description of tJj& development 
of educational television in Georgia would be through a review of important 
dates. 

1 )52 ~ The Federal Communications Commission said. Let there be educational 

television throughout the land. 
1958 - And so it came to pass, work began on a statewide plan for ETV 

in Georgia. 

1960 - Initially as an independent activity WGTV, the University of Georgia 

station began broadcasting. Later WGTV became an affiliate of GETV. 

1961 - The first broadcast of a GETV station, WXGA, a VHF station in Waycross, 
1963 - Enabling legislation was passed. The Act stated that: | 
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The State Board of Education is authorized and 
empowered to make available educational programs through 
the medium of educational television. The State Board 
of Education is authorized and empowered to own, operate 
maintain, and manage television stations, transmission 
equipment, and all other related equipment and facilities, 
both audio and video for the production and transmission 
of oper. and closed circuit telecasting; to furnish schedules, 
consultative services, teacher aids; and to perform all 
other things necessary in promulgating, furnishing, 
producing, transmitting, and making such programs 
available; and is authorized to enter into agreements 
with other agencies, persons, firms, or corporations 
for the production and/or transmission of educational 
television programs. 

196*1 - Educational television given appropriate consideration in Minimum 
Foundation Programs for Education. 

1965 - Interconnect of WGTV (University of Georgia), WVAN, WXGA, and 
WJSP (first UHF station) completed. Simultaneous broadcasting 
from single origination now possible. GETV truly became a network. 

1968 - Present network completed (ten stations) with dedication of 
WDCO in Cochran. 

1970 - Dedication of multi-million dollar facilities of Georgia 
Educational Television Services. 

Initial programming on GETV was concerned with Spanish, Science, 
Mathematics and Music. Series in these areas were aimed primarily at 
elementary and junior high classes. Also available during the early 
years of broadcasting were in-service programs aimed at teachers to 
assist (1) their use of specific telelessons and series, and (2) in 
improving their knowledge of specific subject matter, and teaching 
skills. 



THE GEORGIA EDUCATIONAL TELEVISION NETWORK TODAY 



There are three licensees for ten educational television 
broadcasting stations in Georgia. The University of Georgia 
operates WGTV, Channel 8, which broadcasts from Stone Mountain, 16 



miles east of Atlanta. WETV, Channel 30, Atlanta, is licensed to the 
Atlanta City Schools. Eight more stations covering all but three per 
cent of the population of the rest of the state are licensed to the Georgia 
State Board of Education and operated by the Georgia Department of Education. 
These eight are: WABW-TV, Channel 14, Pelham; WACS-TV, Channel 25, Dawson; 
WCES-TV, Channel 20, Wrens; WCLP-TV, Channel 18, Chatsworth; WDCO-TV, 
Channel 15, Cochran; WJSP-TV, Channel 28, Warm Springs; WVAN-TV, Channel 
9, Pembroke; and WXGA-TV, Channel 8, Waycross. A map showing the location 
of these stations and their approximate spheres of influence can be foqnd 
in ^igure 1-1. In addition more than forty Georgia communities have com- 
mercially owned Community Antenna Television (CATV) systems. The majority 
of these CATV operations receive the Georgia Network programs to provide 
them to their subscribers. Some CATV owners supply cable service to public 
schools without charge as a public service to their community. 

Single TV signals travel in straight lines; their reception can be 
difficult in mountainous terrain. In an attempt to reach public schools 
in difficult areas the Network has constructed translators, devices 
engineered to receive a TV station's signal on one channel, amplify it 
and re-broadcast it on another channel. Three of these signal boosters 
recently were constructed by the Georgia Educational Television Network 
in the north Georgia communities of Clayton (Channel 12), LaFayette (Channel 
17), and Lookout Mountain (Channel 83). The Department is investigating 
the possibility of establishing additional translators. 

The Georgia Educational Television Network is one of the nation's 
largest state-owned interconnected ETV broadcasting systems. A survey 
in 1969 revealed that there were approximately 625,641 students viewing at 
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rnuRE 1-1 




FLORIDA 



Translators 

— Estimated 90% Signal Saturation (Class A Coverage) 
Estimated 50% Signal Saturation (Class B Coverage) 
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least one series, 22,044 teachers using one or more series, and 13,399 
television receivers in the schools. In addition it has been estimated 
that on an average day upwards of 250,000 viewers avail themselves of at 
least one of the late afternoon and evening offerings of WGTV. 

One indication of the importance placed on educational television 
in the state rests on legislation aimed at quality control in its schools 
which is tied to "standards." General standards "for Georgia schools 
compiled as a result of the 1964 Minimum Foundation Act list items as 
"Required," "Essential." and "Desired," In order for a school or school 
system to be declared standard, all required items must be met, and a 
certain percentage of essential and desired items must be in effect. The 
1970 Standards include the following guidelines: 
Required 

The system has a written plan for the utilization of educational 
television. This plan includes the following: 

1. Basic statements about the relationship of educational television ■ 
to the instructional goals of the system. 

^* ETV^^''*^""^ securing and maintaining adequate facilities for 

3. Methods of correlating the local curriculum with television offerings. 

4. Identification of local personnel who are responsible for coordi- 
nating local ETV utilization efforts, e.g. ordering manuals, com- 
piling surveys, and implementing the system's plan in individual . 
schools. 

5. Procedures for involving local administrators, instructional person- 
nel, teachers, the engineering and the utilization staff of Georgia 
Educational Television Services in developing and implementing this 
plan, e.g. administrative planning sessions, orientation meetings 
for new teachers, in-service meetings. 

All teachers using ETV have been provided with the necessary schedules 
and manuals. (Individual teachers must be able to show these materials if 
requested. ) 

10 



Essential 

The building is equipped for educational television with the 

necessary outlets to make educational television available to all 

indoor instructional areas. 

Desired 

The school has a functional master antenna system for ETV, 
The school has availed itself through workshops and/ or individual 
school visits by the ETV Utilization staff or other methods of communi- 
cation, the services of the ETV utilization staff. 

It is obvious that the use of classroom television programming is 
viewed as an integral part of the instructional programs of Georgia schools. 

No Georgia telecourse is designed to replace a classroom teacher; 
rather they are created to serve the function of a team-teacher. Each 
lesson is an intensified program developed with the advice of a committee 
composed of national, state and local authorities in the field. The 
aired lesson is the result of efforts of the studio staff including a 
TV producer, artists, film animators and cameramen, scenic designers, 
researchers and engineering personnel. The planning, development, effort 
and production of the Georgia Educational Television Network telecourses 
have gained extensive national recognition. Several whole telecourses 
have been bought for national distribution. The majority of the network's 
in-school and in-service programs are produced in the Georgia ETV Production 
Center in Atlanta. In addition series from other sources, particularly 
National Instructional Television^ are used. WGTV also produces many of 
its own broadcasts and in addition relies on the offerings of National 
Educational Television. 

11 



The key to effective use of telecourses in the classroom situation 
is the classroom teachers' skill in utilizing the series. To help teachers, 
a division was developed within the Georgia Educational Television Network 
aimed at providing guidance, materials and services which would increase 
effective application of the medium. The utilization staff, which numbered 
15 people in January 1970, helps the teachers in local systems to ade- 
quately utilize the GETV series in their classrooms. 

The original emphasis of the utilization staff was on-the-job selling 
of the equipment and teachers on using television in their classrooms. As 
the teachers began utilizing the equipment and the staff grew, the utilization 
people began going into schools to meetings, workshops, and institutes. 
Now, their concentrated effort is focused on showing the teachers how 
they can build their schedules around ETV and how it can be incorporated 
into their present schedules. 

The utilization staff has two divisions. One group is involved with 
program planning and curriculum, while the second group goes into schools, 
talks with teachers, and conducts meetings about the proper utilization of 
educational television. 

DEFINITION OF TERMS 
Not only should a set of definitions assist the reader in making 
sense of what is to follow, but in addition will provide a perspective 
of what we are about. Terms used in the report may take on meanings other 
than those usually associated with them. 

Closed Circuit Television (CCTV); A system of direct broadcast 
from camera to receiver, by-passing open-air transmission and 
reproduction, and usually carried by cable. 
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relatively 



Communique ; A half-hour service, after school, broadcast serVice 
for teachers featuring the series television teacher previewing 
future lessons. Generally two to five lessons are previewid. 
Broadcasts emphasize lesson content, teacher presentation 
methods, discussion topics, and suggested post-program actiWties, 

Educational Television (ETV): This term has come to cover two 

distinct communication functions: (1) instructional television- 
directed at students in the classroom or otherwise' in the general 
context of formal educatipn, and (2) public broadcasting whilch is 
directed at the general community. 

Field Test: A technique used in evaluation in which procedure^ and 
methodologies are tried out in a setting and with subjects s^s 
closely approximating the target group and setting as possible. 
As contrasted to the pilot test, field testing is (a) less Ijabora- 
tory like, (b) more comprehensive, and (c) more complex. In the 
case of the present project examples of field testing would oe 
the try out of the questionnaires used to survey teachers abi)ut 
their ITV attitudes and practices, and student attitudes toward 
ITV. 

In-Service Program : Usually a non-credit series aimed at improving 

teacher knowledge and skill in her area of competency. Weeklly 
« 

broadcasts typically cover subject matter areas of reading, 
English, and oral and written compositions. 
Instructional Television (ITV): The in-school educational broadcasting 
generally week days from 8:30 a.m. to 3:00 p.m. covering sulpject 
matter conten^jorary with school curricula. Series in the f6rm of 
. articulated programs (usually 33) run from 15 to 30 minutesj. Major 
portion of programming is aimed at elementary school. 
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Manual: Publication produced by GETV and available upon requeij by 
teachers covering full years programs for a specific series 
Manuals contain lesson objectives, pre- and post-program su^ 
activities for students, and reference reading for students 
teachers, materials and vocabulary lists, and overview of pro-am 
content. Programs are cross-referenced to state approved t\\ 

Model: A scaled paradigm representing the total operation of 
cular larger system under investigation. In the present stiidj 
model refers to a paradigm describing methods and activities 
useful in continuous evaluation of the Georgia Educational 
Television Network, 

Patterns Teleseries: (See Series) 
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Pilot Test : A procedure used in evaluation to establish feasi- 
bility of using specific method or instrument with a small 
in a highly controlled situation. Comes before field testirjg 
and usually has more limited objective. 

Program: Generally refers to that 15 to 30 minute broadcast, 

once a week, covering relatively limited number of instructjL<i)n^l 
objectives. 

Broadcasting ; Programming basically made up of culturil, 
children's, public affairs and other single purpose telecaits-. 
Programs may be broadcast on continuing or one short basis|frc 
about i+:00 p.m. to sign-off around 10:30 or 11:00 p.m. 
Series: The complete collection of articulated instructional lire grams 
(generally 33 to a series) in a particular subject area airkd 
during the course of an academic year in a sequented fashiol 
Series parallel most academic disciplines currently used in tke 
classroom. 

in 
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'two series ca»vi'^ uudci* intense scrutiny in the present rroject. 
These v/ere a second gra-Ie social studies series; Wonderful Vj^u 
and a sixth grade pv-jth :::o/'iei: Fatt'-^rns. 

' j:rKkr^ V^-^u ~ Grade S 
The ^najor oJDjective cl this social studies program is to 
guide i-he child tov/ard a Detter understanding of what is human 
about man and hov/ he can become rnoi'^e so. Five forces which shape 
man's humanity suggested by Bruner are touched on. Namely,- tools, 
education, language, man's urge to explain and to interpret his 
world, and social organization. Concepts, attitudes, and skills 
are considered. The interdependence of man will be stressed. 
Specifically evaluative research efforts involved Lesson 32 "Plan- 
ning More Human Communities," and Lesson 33 "Let's Build for 
Tomorrow Today, »» 

Patterns - Grade 6 
This "discovery" oriented approach to basic mathematics encourages 
student creativity and classroom participation. It is designed to 
help the student develop logical thinking patterns progressing 
from observing, guessing, andgeneralization to predicting mathe- ; 
matical events. Specifically the following lessons were evaluated: : 
Lesson 30 -.Volume I, and Lesson 31 - Volume II. 
Teacher Aid ; (See Manual ) 
Telelesson t (See Program ) 

Utilization : As used here utilization means effective integration of 



1 

A list of student and teacher objectives for both these 
series can be found in Appendices K, 0, and Q of Volvune ii. 
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ITV programs into curriculum. Unfortunately little qualitative 
data were gathered during the initial stages of evaluation and the 
staff had to rely primarily upon frequency of reported use as an 
index of utilization. . 
Wonderful You Teleseries: (See Series) 



LIMITATIONS 



. Again it should be emphasized most emphatically that the efforts here 
reported were exploratory. The usual rigorous criteria applied to research 
are not legitimate in the present case. Only field and pilot tests were run. 
The data were for planning, refinement and modification of instrumentation. 
Data useful in making generalizations about television in the state were 
not gathered. 

As with most projects of this type time was a severe limitating factor. 
This was particularly true in this case as the problem was not and really 
could not have been delineated from the beginning. Time was also a factor 
because of the need to get into the schools, it being only weeks from 
summer vacation. Timing in the public survey was probably poor due to close- 
ness to income tax deadline and civil disturbances in various locations 
throughout the state and nation. It is necessary, however, to note several 
specific limitations of the present efforts. These are: 

1. Failure of school and teacher survey of ITV practices and 
attitudes to truly represent the state. 

2. Extremely low return of public broadcasting survey questionnaires. 

3. The usual shortcomings of self-report measuring instruments. In 
the present case questionnaires and rating scales. 
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4. Lack of any control over content and methods of teachers involved 
in the Patterns and Wonderful You experiments. 

5. Insufficient training of classroom observers. 

6. Failure of Wonderful You and Patterns series, both the programs 
and communiques, to represent the major types and quality of 
GETV programming. 

7. Possible bias in public broadcasting survey due to sampling 
limited to large metropolitan areas via telephone directory lists. 

ORGANIZATION OF REPORT 
Two documents will be used to .-eport the finding and recommendations 
of the project. In Volume I the activities directly involved with develop- 
ing the evaluation model itself ate described. Volun,e I is divided into 
■six chapters. After the problem area, purposes and characteristics of the 
network are specified in the first chapter, a brief overview of the research 
literature is presented. This summary is followed in Chapter Three by 
an overview of the research and evaluation activities. The model itself 
appears in the fourth chapter. Chapter Five contains recommendations resulting 
from feasibility studies. The volume concludes with a summary and 
suggestions for future research. The four chapters of Volume II contain 
summaries of the research studies conducted during the development of the 
GETV Evaluation Model. Specifics with regard to sample characteristics, 
statistical analyses, instrument development and try out. etc. are to be 
found here. 
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Chapter 2 

A BRIEF REVIEW OF EDUCATIONAL TELEVISION RESEARCH LITERATURE 

During the last two decades in which the influence of television has 
made impact on the American public, the concurrent development of educa- 
tional television has had significant and specific impact on children. 
From the 400 or more major studies evaluating the effects of educational 
television, several generalizations maj' be made. 

INSTRUCTIONAL TELEVISION AND LEARNING 

Student Achievement 

The introduction of ITV Lessons into the classroom has the possibi- 
lity of improving or maintaining current levels of student achievement. 

In one of the largest projects evaluating educational television 
(Hall, 1962) the sample of 30,000 elementary and secondary students 
benefited from instruction in the following areas: Spanish, music, art, 
science, literature, ' history , safety, English, civics, and biology. 
Comparisons were made in this study between television and face-to-face 
modes of presentation. Analysis of achievement scores relative to the 
pre- test performance of the student indicated there were no significant ' 
differences in the results in elementary schools, or between a television 
method of teaching and conventional face-to-face methods in secondary' 
schools. 

Achievement of pupils relative to number of successive years of 
exposures to educational television indicates that learning increased in 
proportion to the length of TV use. These results (Morgan, 1963) were 
observed with both rural and urban students, with greater gains being 
made by the rural groups of students. 
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Some indication seems to be px^esent that academic achievement with ITV 
is dependent on activities which follow the television presentation; i.e. 
supplementary lessons following programs. Other factors influencing effec- 
tiveness and achievement and the student interest are: pacing of lessons, 
opportunities for student participation, variety, and relevance of mater- 
ials (Himmler, 1957). Attitudes of teachers quite strongly influence the 
overall feet of the > medium on pupils. Enthusiastic teachers are likely 
to have students with higher interests for television as well as comparable 
or better achievement scores than conventional face-to- face classes. 

A significant point regarding science (and other academic areas) is 
outside the realm of academic achievement. Based on the direct comparison 
between ETV and face-to-face groups, it has been shown that ITV achieve- ' 
ment scores do not seem to yield higher measures than face-to-face methods , 
nor do retention, interest, or attitude scores seem to vary greatly across 
the teaching methods (Amiran, 1963). There is some indication that mea- 
sured achievement on standardized tests not designed around the telelesson 
specifically is higher with television presentation (Jacobs g Bollenbacher, 
1960). This phenomenon may be explained by the programmed nature of some 
presentations with immediate feedback of "right" and "wrong" answers. 

Student Attitudes 

Instructional Television has emphasized heavily the assessment of 
attitudes of students and teachers. These attitude . studies vary greatly. 
In some studies students have been negative to Instructional Television; 
in others the student opinion has been very favorable; many studies pre- 
sent neutral opinions. 
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The U.S. Department of Health, Education, and Welfare's 1967 Research 
activities in Instructional Television indicates "students' opinions are 
most probably a function of the attitudes of their teachers, or of the 
quality of the instruction presented to them by means of television, in 
most cases it would appear that students' attitudes have not been a 
serious barrier to the use of instructional television (p.l2)." 

Most student attitude studies toward ITV found little or no relation- 
ship between attitudes toward or specific preferen-^es for various modes 
of instruction and actual achievement from these methods. 

Schramm's (1962) investigation of student attitudes toward Instruc- 
tional Television indicated grade school children think they learn more 
from television than do high school and college students. In lower 
grade levels attitudes are generally favorable or unfavorable to the 
entire range of programming. As grade level increases, attitudes 
become specific to individual programs and categories of programs. 

ITV AND THE CLASSROOM TEACHER: 
IMPACT ON KNOWLEDGE AND METHODOLOGY 

Many comparisons have been made with teachers and students involving . 
all elementary and secondary school subjects, attitudes of teachers, 
methods of ITV presentation, size of classroom, and effects of performers. 
The key variables in such studies generally relate to the impact on 
knowledge, or achievement in the case of the student and upon attitudes 
in the case of the teachers.. 

Underbill (1969) found, that teachers using ETV are generally poorly 
trained and relatively inexperienced in the area of ETV use - a fact 
compounded with the indication that these very teachers are not given 
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enough help in proper ase rf ETV. Many schools are poorly equipped to 
handle ETV. Television series produced fall short of the expectations 
that teachers have for ETV. 

A good teacher may teach effectively with television. Not all useful 
activities, however, can be treated by television. Illustrative of some 
problem areas are: discussion, laboratory work, theme writing, and home 
work. However, "to the extent that teaching goes on by means of lecture 
and demonstration, then television has an unequaled ability to share the 
best teaching and the best demonstrations (Schramm, 196U)." 

The patterns of use of ITV are presently supplementary to currently 
'operating academic programs in many schools and in some cases complementary 
and integrative, also speculative conclusions and implications seem to 
indicate the role of the classroom teacher is little effected by the intro- 
duction of instructional television under prevailing conditions. The 
patterns of ETV use are currently conventional. Use patterns actually 
employed by ETV classroom teachers seem to differ considerably from pattern- 
nonparticipating teachers think they would employ. Fears and misconcep- 
tions that nonusing teachers have regarding instructional television, how- 
ever, seem to disappear when their experience with the me'dium is increased. 
Users of ETV are generally more favorable to both instructional television 
and newer educational media than nonusers of ETV (Underbill, 1969). 

Attitudes 

Teacher attitude, clearly in the positive direction in most studies, 
serves as an additional teacher influence or use of ITV. Also, in the 
area of controversial topics, ETV offers the instructor an opportunity 
to expose children to controversial tonics with which the teacher is 



reluctant to deal: examples include communism, sex education, and other 
related controversy (Culver, 1967). 

Teacher attitudes towards educational television are colored by the 
fact that TV is generally considered entertainment. This fact obviously 
influences it as an instructional medium. It is already clear that 
children's learning should be integrated with their experiences and their 
environment, so that what they learn in one environment has meaning and 
relevance in their experience of the other. Teachers and evaluators are 
concerned that TV and school should not be separate (Kuhns, 1968). 

, Further attitudes toward ETV are concerned with "reteaching** ~ that 
is to say, having the teacher elicit the same material from students that 
the television teacher has just presented. Klasek (1967) feels teachers 
should avoid followup instruction of reteaching. Followups should be 
geared to activities which will assist children in understanding con- 
cepts and to allow them to form their own generalizations. Good teachers 
already do this; poor ones do not. 

Freeman (1967) redirects teacher attitudes towards educational use 
of TV from a passive response or timekiller to a flexible tool within the 
system of instruction. In order for the medium to be efficient from 
theoretical standpoints (and from practical ones), the establishment of 
specific educational objectives is a mandatory part of the use design. 
The preparation of specific educational objectives has within its model 
the necessity of continuing through such a plan with direct observation 
of students (Orr, 1966). These behavioral objectives further require the 
preparation of explicit rationables for the measurement of each objective 
according to some kind of plan or general outline. Development, tryout 
and revision of standard, quantitative and objective measuring instruments 
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for the assessment of behaviors relevant to the particular behavioral 
objectives is further seen by Orr to be necessary. 

The factor of protective security in educational television offered 
to inexperienced or less qualified teachers is one reason why these 
individuals seem to report favorable attitudes. Comfort is derived from 
the reliance on another teacher assuming academic responsibility (Westley 
6 Jacobson, 1963). * 

Based on a review of a large number of studies it appears that languages 
are among those subjects most effectively taught by ETV. The teaching of 
Spanish, French, German, and Russian have all been researched with conclu- 
sions that aural-oral skills may be taught well with ETV. The important 
point with regard to languages is the inclusion of a master teacher with 
unusual skills and presentation abilities (Alabama, 1961; Coleman, Button 
6 Bookout, 1960; Gordon, Engar 6 Shupe, 1963; Spatagore, 1969). 

GENERAL IMPACT OP ITV 
FACTORS INFLUENCING ITV EFFECT 

Students of languages have indicated that it was easy to learn by 
television because they had to listen more carefully and respo nd actively 
in a programmed fashion — adding structure to the classroom method of 
instruction on the face-to-face basis (Silagyi, 1961). 

Active responding of students to the television teacher, as in the 
study of languages, has been found to be important in* science instruction. 
Sciences are particularly amenable to good ETV instruction due to the fact 
that elaborate laboratory presentations may be performed without flaw, and 
that school systems without their own laboratory materials may effectively 
participate in a science program at levels which they would not otherwise 
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enjoy. Science, sometimes a dull subject in conventional settings, can 
be stimulating enough to spur student interest. Attitudes with respect 
to science programs are more favorable after the series has been completed 
(Schlaak, 1956). 

Negative attitudes towards educational television are not unusual 
or unexplainable. Chiefly fear of mechanization, fear of the ETV teacher 
becoming unimportant, lack of student feedback, and distrust of measuring 
instruments and researchers are all certainly to be considered (Handleman, 
1960). 

Parental attitudes regarding ETV are similarly important in an overall 
study of effectiveness. Clarke (1965) found that youngsters whose parents 
placed more importance on "doing well in school" rather than "being curious 
about things" seemed to do less well from the achievement standpoint and 
were less likely to watch ETV meaningfully and . ,ss likely to respond its 
social rewards. 

Organizational climate in the schools, a factor influencing utili- 
, zation of ITV, presents several topics for consideration: administrative 
leadership, administrative attitudes, and administrative knowledge of 
television facilities. 

Planinc (1967) investigated the above topics and found that admini- 
strative leadership was the most important feature in ITV utilization. It 
was also apparent administrators as a group received but did not absorb 
information relevant to ITV. Attitudes and interest of administrators 
and others (teachers) are directly a function of knowledge of the medium. 
Another factor affecting utilization included individual school facilities 
for the reception of ITV. 

Wade (1965) summarized guidelines for administrators for the adoption 
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of ITV and reported that these personnel should be aware of which programs 
and grade levels would be receptive to efficient ITV usage. Also the 
administrator should be aware of the particular effectiveness of small 
class viewing as well as large group viewing. (No significant differences 
in achievement are currently reported in large vs. small classes.) Also, 
the administrator should, if felt necessary, be prepared to change the 
organizational climate of his school chiefly by informing, teaching, per- 
suading, and motivating his staff towards the idea of television in the 
school. 

La Penna (1967) discussed the design, implementation, and evaluation 
of a model program for in-service training dealing with ITV utilization. 
He found that teacher attitudes changed significantly in favor of instruc- 
tional television after in-service training. 

The obvious importance of the concept of feedback is a frequently 
mentioned topic in the literature (Clarke, 1965; Culver, 1967; Diamond, 
and programmed stimulus-response instruction are topics included in such 
a design. Since "the utilization of television begins and ends with the 
student (Culver)," the student is quite obviously the determining force 
in the total instructional program. Loss of sight of this facet of edu- 
cational television is not allowable. Critiquing sessions need to be 
developed for each television series involving all personnel involved: 
production to the student himself. In this manner ETV is seen as a 
learning medium rather than simply a teaching medium. 

Examining the feedback studies on ETV, it becomes apparent that a 
major issue encountered by researchers is the lack of precise differen- 
tiation among the various forms of feedback. (Greenhill (1964) examines 
feedback from information theory standpoint which indicates the receiver 
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communicates back directly to the communication source. In ETV this is 
not possible, Zettl (1967) carries these ideas into a direct classifi- 
cation scheme outlined briefly as follows: direct feedback (viewer 
reacts directly to the communicator); direct immediate feedback (viewer 
asks the teleteacher questions during the show); direct delayed feedback 
(student waits until end of telelecture to respond to the communication 
source); and various models for indirect feedback which are currently 
the only practical way to monitor student and teacher reactions from the 
standpoint of practicality. 

Without a precise classification of the various types 
of television feedback studies which claim to measure the 
effect of feedback against no feedback, we may actually 
compare merely one type of feedback against another type 
of feedback... A reclassification of television feedback 
into several distinctive types may help the researcher to 
construct more precise research designs that actually 
measure what they set out to measure, and it m^ also help 
the program originators to produce more effective programs 
(Zettl, 1967, 936). 

Lesson manuals of the type currently available for use with parti- 
cular series which specify content seem to be one means of improving 
feedback. Chabe (1962) found ETV viewers with lesson guides were almost 
twice as efficient as those without the guides. 

Feedback is an important variable for both learning efficiency as 
well as upgrading the particular television series. Lack of precision 
of feedback is definitely an issue with the medium. 

The effects of class size investigated appear to conclude that there 
is no appreciable difference in students in elementary, secondary, or 
college levels. Carpenter and Greenhill (1958) concluded there was no 
effect on learning and student attitudes in small or large classrooms. 
Driscall (1959) found no differences in final examination scores for 



ERIC 



26 



candidates for the degree in elementary education who were enrolled in a 
course of introduction to education. French (1963) similarly found no 
differences in large classes over small with respect to scholastic aptitude, 
grade point average, and age. Rothchild and Lastinger (1961) present the 
most convincing argument for the lack of relationship between class size 
and achievement. In their West Coast study in Florida, with an N of ap- 
proximately 7,000 students at elementary and secondary levels, it was con- 
cluded that studeivts learn as effectively in large classrooms with ETV 
as students in face-to- face classrooms. 

Differences do exist within students with regard to intelligence. 
Both the dull and the bright profit from face-to-face instruction 
(Englehart, Schwachtgen, and Nee, 1958; Gordon, Engar, and Shupe, 1963). 
Englehart, et. al. feel that the students with IQ's above 120 and below 
100 profit from face-to-face instruction. Gordon et. al. found the chal- 
lenge to superior students was not sufficient under television modes of 
presentation to maintain their interest over a period of time. 

A further factor influencing ITV effectiveness is mentioned by 
Howell (1968) regarding in-service training. This type of training is 
sometimes (1) directed to the school staff by television, (2) conducted 
in workshops, or (3) conducted by observation of a television master 
teacher. Curriculum guides are also employed in such methods as in the 
case of the science programming in New York and Georgia. 

Communique programming, a useful adjunct, to the in-service training 
employs a television teacher previewing curriculum guide study materials 
with viewing teacher prior to the classroom teachers' use of the lessons 
with her own students. This approach may be of potential positive signi- 
ficance in educational television. 
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Research and development activities pursuant to the goals of ITV 
frequently are of the opinionnaire type used by Educational Networks 
(National Educational Television Survey, 1969). Such research activities, 
summative in nature, sample audience feelings in frequency of viewing ITV, 
programming preferences, characteristics of the viewership, and suggested 
changes in programming. 

These feedback data collected from research and development activities 
are often quantitative, but more importantly are behavioral investigations 
with general and specific educational implications. 

It is safe to say that good teachers can teach effectively with ETV, 
that his role is little affected in general by its introduction to his 
classroom. Utilization of the method, however, is a variable which 
appreciably affects the effectiveness of ETV. Students appear to learn 
as well or better in ETV classes as they do in face-to-face situations. 
Certain areas of specialty appear to be enhanced with the introduction of 
ETV due to the quality of the presentation as well as standardization. 
Many negative aspects result not from lack of student academic achievement, 
but rather from personal attitudes on the part of the teacher in the 
classroom, or the inability to schedule programs at suitable times. All 
levels of personnel are ultimately involved in a school system. 

PUBLIC BROADCASTING 
Public television broadcasting is that aspect of educational tele- 
vision which serves chiefly the adult needsof the community through the 
medium. The National Instructional Television Center (1969) outlined 
some of the general features. First, public television assists population 
to perform new social tasks and to assume new social roles. -Also public 
television allows adults to continue learning through specific educational 
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objectives and programing. Second, public television is a unique resource 
in the society for carrying on self-criticism. 

Participants in public television often include (1) adult learners, 
(2) educational institutions, and (3) financial agencies. In terms of 
content, the medium offers adults practical rather than academic infor- 
mation; applied rather than theoretical; and skills rather than knowledge 
or information. 

Categories of programming often include the following: vocation, 
'hobbies, recreation, religion, public affairs, agriculture, and personal- 
social development. The above categories collapse into three general 
categories: cultural, public affairs, and informal adult education. 

Transmission in public television programs usually occurs through 
cooperation with local and state educational television networks in 
addition to VHF-UHF television stations composed of commercial and public 
broadcast stations. Attempts are frequently made to beam broadcasts to 
areas where reception is inadequate for major network programming. 

The relationship between continuing education programming and other 
major programming categories of public broadcasting are difficult to 
discern. Instructional television is directed at classroom students; 
public television is directed at the general community (The Report and 
Recommendations of the Carnegie Commission on Educational Television, 
Public Television, Harper £ Row, 1967). The Carnegie Commission believes 
that public television should present "all that is of human interest and 
importance which is not at the moment appropriate or available for support 
by advertising, and which is not arranged for formal instruction (p. 1)." 
Programs not arranged for formal instruction belong-, within public 
television. Instructional television is considered a separate domain. 
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Schranun (1963) summarizes some of the implications of public educa- 
tional television. He found that approximately 10 - 24% of the adult 
population watched ETV regularly; the composition of this audience is 
abnormally high in professional and. white collar categories. This 
audience already has the opportunity for education, and regards ETV 
as culturally satisfying rather than "fun" Schramm (1962) also mentions 
there is no "average" audience but rather groups of viewers who vary 
with the kinds of programming and with local educational and cultural 
levels. Reaching broader spectrum of the general population still remains 
a problem of ETV. Financing also remains a problem, a variable not so 
pressing in commercial television. ETV is also regarded as a distinctive 
medium whose future rests partially in providing its own writers, tech- 
nicians, and talent. 



ERIC 



30 



Chapter 3 

BRIEF OVERVIEW OF PROCEDURES 

The procedures used in the development and establishment of the 
evaluation model are summarized in this chapter. The procedures used 
in this study were largely inductive in nature and have resulted in a 
product that is applicable to the overall evaluation of a state educa- 
tional television netv/ork. Volume jj of this report contains a more 
detailed report of the research that was conducted as an integral part 
of this project. 

As per the request of the contractor (Georgia Department of Educa- 
tion) the project staff devoted the majority of its resources to devel- 
oping a model with particular emphasis on the instructional portion of 
educational television. However, proportionate emphasis was placed on 
the public aspects of educational television. 

SOURCES OF PLANNING IDEAS 
In order to investigate the present status of educational tele- 
vision in the State of Georgia it was considered necessary to inter- 
view a sample of personnel engaged in the production, distribution 
and use of the medium. Initially the staff constructed a list of 80 
questions about the use, status, problems, etc. of educational tele- . 
vision in the state. Various members of the staff of the Georgia 
Educational Network responded to these questions. A second series of 
interviews was conducted with those engaged in the field in the use 
of instructional television. This group consisted largely of teachers, 
principals and other selected educational and communications experts. 
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Teachers and principals were interviewed in 18 school systems in 
Northeast Georgia, Metropolitan Atlanta and Southeast Georgia. Wherever 
possible, teachers were observed using instructional television in their 
classrooms. In general the interview questions centered around the 
relationship of instructional television to the students and school 
administrators, supplementary materials available and their use,- the 
utilization of television in school, scheduling problems and the use 
of communiques. 

In order to secure additional information from groups involved 
in the evaluation of educational television, visits were made to con- 
sult with staff members of the Ford Foundation, Childrens Television 
Workshop,and the National Instructional Televis-'on Center in Bloomington, 
Indiana. Staff members of these organizations made pertinent sugges- 
tions with regard to development of the model and for revision of much 
of the software described later. 

Another major source for planning ideas was found in an extensive 
review of the literature of educational television. This source served 
as a basis for ideas for the development of software and served also 
as a beginning point for understanding the processes used in educational 
television. Chapter 2 of this volume contains a brief review of the 
literature centering on research related to the evaluation of educational 
television. 

Concurrent with the above procedures, continuing contact was main- 
tained with the staff of the Division of Planning, Research and Evaluation 
of the Georgia Department of Education. This group provided suggestions 
and assistance throughout the development of the model. 
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INSTRUMENT DEVELOPMENT, PILOT TESTING AND REVISION 
A major objective of the Georgia Educational Television Evaluation 
Project was to develop software and a plan for its use, suitable for 
gathering data relative to the general impact of educational television 
in the State of Georgia. The instruments developed during this project 
fall largely into two categories; those that can be used without addi- 
tional development, and prototype or sample devices. This last group 
Of instruments includes such things prototype achievement tests and 
observation schedules. All instruments were developed, pilot tested 
and/or revised. For purposes of this chapter, these instruments have 
been grouped into three types; questionnaires related to instructional 
television, instruments developed in conjunction with evaluation of the 
effectiveness of instructional television aids, and a questionnaire re- 
lated to public broadcasting. 

Questionnaires 

Following is a brief description of the development, pilot testing, 
and revision of a series of questionnaires designed to assess factual 
use information, as well as the opinion, educations, feelings and atti- 
tudes toward instructional television of five major populations; stu- 
dents, teachers, principals, supervisors or curriculum directors, and 
parents . 

Student Form . A primary concern in the effective use of television 
in the school, is the attitude and opinions that the consumers (students) 
have with regard to the medium. In order to investigate the attitudes 
and opinions of children toward instructional television two questionnaires 
were developed, one for the lower elementary grades (2nd and 3rd) and 
one for the upper elementary grades (5th through 7th). 
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The lower grades student questionnaire consists of twenty questions 
inquiring into how a child feels about various aspects of television in 
school. The test is administered as a group instrument with each child 
responding on an answer sheet by marking a picture of a smiling or 
frowBing face (corresponding to his feelings toward the statement made 
about instructional television). Items on this questionaire relate to 
the things that are done before and after the class watches television 
in school, the feelings each child has for the television teacher, the 
attitudes of their parents toward television in school and the use of 
television in the home. This instrument was pilot tested with children 
in three classrooms of second and three classrooms of third grade stu- 
dents (NS165). 

The instrument appears to be a valid and reliable measure of lower 
grade elementary children's feelings toward instructional television. 
No revision was made in this instrument. A more detailed explanation 
of the use and results of the pilot administration of this instrument 
is contained in Volume II of this report. A copy of this instrument 
will be found in Appendix B of this Volume. 

The upper grades student questionnaire consists of two parts, 
the first being composed on fifteen yes-i . questions. Part 2 contains 
thirteen completion questions similar to those developed by Perrodin " 
(1966) to determine children's attitudes toward science. These questions 
centered on the same general areas of interest as the lower grade instru- 
ment. This instrument was pilot tested with 89 sixth grade students. 

Results of the pilot test indicated that the instrument could be 
effectively used in measuring children's attitudes toward and opinions 
about instructional television. No revision was made in this instrument. 
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a more detailed report of the use of this instrument ia contained in 
Volume II of this report. A copy of this instrument will be. found in 
Appendix C of this Volume. 

Teacher, Principal^ and Supervisor Forms . Questionnaires were 
developed for each of three main groups of school personnel: teachers, 
principals, and curriculum directors and supervisors. The three 
questionnaires were parallel in construction and designed to gather 
' in^'ormation about the relationship of instructional television to 
students and to school administrators; supplementary materials available 
for use with instructional television; utilization of instructional 
television, including scheduling problems; use of communiques and cer- 
tain personal data about each respondent. The teacher questionnaire 
contained 44 yes-no items, the principal questionnaire was composed 
of 30 yes~no items and the supervisor questionnaire contained 21 
yes-no items. In addition all forms contained a list of sixty adjectives 
that each subject was asked to mark either yes -or no depending on 
whether he agreed that that particular adjective was descriptive of 
instructional television. This list included such words as good, 
foolish, difficult, expert, wise, etc. In addition, all questionnaires ' 
contained eight items of personal information (years of experience, 
level of certification, etc.) and five free response questions such as 
what kinds of programs would the respondent.-'like to see aired on 
instructional television. 

The teacher questionnaire was administered to 27 elementary class- 
room teachers, the principal questionnaire was administered to 37 princi- 
pals (both elementary and secondary) and 34 curriculum directors and 
supervisors completed the supervisor questionnaire. Results of these 



pilot administrations for principals, and curriculum directors and suoer- 
visors are contained in Volume II of this report. The Teacher ITV Ques- 
tionnaire was then subjected to an extensive field testing (see Chapter 
1 of Volume II). 

After pilot testing each instrument was submitted to two experienced 
representatives of the group the questionnaire was designed for, (e.g. 
the Teacher Questionnaire was submitted to two experienced elementary 
classroom teachers) for detailed analyses and comments. In addition the 
questionnaires were submitted for review to the staff members of the 
Children's Workshop and the National Instructional Television Center. 
Based on recommendations of these groups and analysis of pilot testings, 
the questionnaires were redesigned providing each question or statement 
with a rating scale of 1 to U or 5. Many items and questions were 
eliminated and additions made. The revised teacher questionnaire con- 
sists of 62 items, the principal questionnaire 53 items, and the 
supervisor questionnaire 45 items. Copies of these instruments will 
be found in Appendices D,E, and F of this Volume. 

Parent Form. In order to insure a comprehensive evaluation of 
the full spectrum of the populations involved in instructional television, 
a parent questionnaire was developed which contained eight yes-no 
questions. These questions centered on the knowledge and attitudes that 
parents had of the use of instructional television in school. This instru- 
ment was completed by parents representing 24 families who were in atten- 
dance at a PTA Meeting. Complete details of this administration of the 
parent questionnaire are contained in Volume II of this report. Based 
on this pilot test, no revision was made in the instrument. Appendix G 
of this Volume contains a copy of this questionnaire. 
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EVALUATION OF EFFECTIVENESS OF COMMUNIQUES AND PROGRAM AIDS 

The key to the effectiveness of any television system' or network 
must rest on the quantity and quality of utilization and student learning 
One may begin with a series or program which, on the basis of pretesting 
and application of formative evaluative methods, has been demonstrated 
to bring about appropriate changes in student behavior, but if the pro- 
gram or series is not properly utilized objectives are not met. The 
Georgia Educational Television Network broadcasts a series of teacher 
communiques designed to assist the classroom teacher in effectively 
utilizing television. These half-hour programs suggest methods for 
preparing students for the telecourses, provide brief overviews of the 
objectives and content of the telecourses and suggest classroom follow-up 
activities. 

In addition to the communiques, the Network provides program manuals. 
These publications are designed to provide the classroom teacher with 
information about the content of each telelesson,as well as the total 
sequence. These teacher aids provide for the incorporation of audio- 
visual aids, use of community resources, student research, projects and 
field trips. Central to each lesson description is the specification of 
objectives for that lesson and supplementary instructional materials. 

In order to assess the effectiveness of these aids the following 
evaluation was conducted. This evaluation was not aimed at specific 
programs but was used to demonstrate the feasibility of using the 
methodology in evaluating the impact on the entire network when changes 
in the communiques and/or teacher aids are made. 

The communiques accompanying the second grade social science series 
Wonderful You and the sixth grade mathematics series Patterns that were 
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aired April 6th and l^tli, rt*spectv/e.ly, were chosen for detailed evalua- 
tion. The manual materials related to the Wonderful You lessons 32 
(aired 5/4/70) and 33 (aired 5/11/70) and the Patterns lessons 30 
(aired 4/20/70) and 31 (aired 4/27/70) were also chosen for detailed 
evaluation • Teachers that were users and non users of these proe;ram 
were identified by the tilization Unit of the Georgia Educational Tele- 
vision Network in cooperation with local school personnel. These teachers 
were asked to participate in the evali:?tion of these two series. They 
were assigned to groups as follows : 

Wonderful You !• View only communique 

2. View communique and study manual 

3. Study manual only 

4. Teacher and students view only lessons 32 and 33. 
This group were non-users of the program, 

5 . Control . 

Patterns 1. View only communique 

2. View communique and study manual 

3. Study manual only 

4. Control 

Teachers in groups 1-3 were asked to teach, utilizing the television 
lesson as they normally would in their classes. A summary of the sample 
sizes involved in the studies is presented in Table 3-1. 

Communique and Manual Evaluation Forms 

In order to provide a comprehensive evaluation of instructional .tele- 
vision it was necessary to develop instruments to evaluate both communi- 
ques and manuals. After careful examination of many evaluation devices, 
primarily designed for manuals and a careful review of numerous communi- 
ques a 19 item instrument was developed for evaluation of each communique 
(See Appendix H). Teachers are asked to rate a series of items, about 
each communique on a scale of 1 to 5 with 0 being used if the item did 
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not apply to the particular communique. The Communique Evaluation Form 
can be used with any communi- ue, one form being completed by each teacher 
for each communique watched. A Manual Lesson Evaluation Form consisting 
of 20 items relative to any lesson in a manual was developed (See Appen- 
dix I). Again teachers are asked to rate a series of questions about 
each lesson in the manual on a scale of 1-5. A form is completed for 
each lesson used. In addition a seven item scale was developed that is 
completed once for each manual used. Items on this scale are rated from 
1-5 and relate to the manual as a whole. 

Achievement test and observation schedule 

Two experienced classroom teachers at appropriate grade levels 
viewed the tapes of the communiques and lessons and reviewed the manual 
lessons for both Wonderful You and Patterns . From this review of the 
materials these teachers derived both teacher and student behavioral 
objectives. These objectives constituted the expectations of the ways 
in which teacher behavior (as a function of coimnunique or manual exper- 
iences) or student learning should change as a function of having been 
exposed to these materials. 

From the behavioral objectives, achievement tests for the students 
in the second and sixth grade were constructed. From the behavioral 
objectives constructed for the Wonderful You communique and manual lessons, 
a prototype test designed for second grade teachers was constructed. 

Based on the objectives derived from the communique and manual 
accompanying the Patterns series a prototype observation schedule - the 
Patterns Observation Summary (POS) (See Appendix J) was constructed by 
the staff of the project and submitted for review to an expert in the 
field of teacher observation techniques. This schedule consists of the 
things that a teacher might do in her classroom before or after Patterns I 
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lessons 30 and 31. 

The prototype instruments developed for assessment of student and 
teacher achievement and for teacher observation are specific for the 
telelessons in question. The techniques employed, however, can be used 
for developing similar devices for any set of telelessons or communi- 
ques. The achievement tests and all objectives can be found in the 
appendices of Volume II. 

Wonderful You Evaluation. On the 6th of April the teachers in 
groups 1. 2 and 3 met in a central location. Prior to this meeting the 
teachers in groups 2 and 3 had been asked to study manual lessons 32 
and 33. Groups 1 and 2 met together and viewed the communique. After 
viewing the communique each teacher completed a Communique Evaluation 
Form and the prototype teacher achievement test. Teachers in group 2 
also completed a Manual Evaluation Form for lessons 32 and 33. Teachers 
in group 3 completed the Manual Evaluation Forms for lessons 32 and 33 
and also prototype teacher achievement test. Teachers in the control 
group, group 5, completed only the prototype teacher achievement test. 

The classes of teacher in groups 1 through 4 viewed lessons 32 
and 33 as part of their regular classroom activities. Classes of teachers 
in group 5 did not have television available in their school. 

After the students had viewed the tel.:lessons in questions, classes 
were chosen at random, from those participating in the study for post 
testing. The post-achievement test was administered in each classroom 
by a trained examiner, in most cases junior college students. A summary 
of the number of classes tested is shown in Table 3-1. 

Volume II, Chapter 2, of this report contains a detailed summary 
of the procedures and results of this experiment. 
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Patterns Evaluation. On the 13th of April teachers in groups 1, 
2, and 3 met in two central locations. Prior to this meeting; teachers in 
groups 2 and 3 had been asked to study manual lessons 30 and 31. Group 
2 met and viewed the communique and completed Communique and Manual 
Evaluation Forms. Groups 2 and 3 met together. Group 1 viewed the 
communique and completed Communique Evaluation Forms , while group 3 
completed Manual Evaluation Forms. 

Eighteen junior college students were trained in how to use the POS # 
Teachers were observed for thirty minute intervals on the day before 
their class saw each Patterns lesson and aeain the day after. A summary 
of the number of teachers observed is presented in Table 3^1. The 
classes of teachers in groups 1 through 3 viewed lessons 30 and 31 as 
part of their regular classroom activities. The day following the last 
observation, the observer administered achievement test to the classes 
indicated in Table 3-1. 

A more complete description of this exoeriment, including results^ 
will be found in Chapter 3 of Volume II of this report. 

PUBLIC BROADCAST SURVEY 
The methodological problems involved in assessing public broad- 
casting are varied and of great dimension. The magnitude of the problem 
is seen in the fact that the Ford Foundation will spend several millions 
of dollars in the next year and a half investigating evaluation problems. 
Based largely on a report and instrument developed by McGraw-Hill under 
contract with National Educational Television (Siec;le, 1969), a device 
was constructed specifically designed to survey the public television 
audiences in the State of Georgia. In order to pilot test this instru- 
ment, a sample of 164 households was drawn from the Athens, Georgia tele- 
phone directory. The instrument was mailed to each household with a 
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brief cover letter and self-addressed envelope- The initial response 
to this questionnaire was favorable with a total return of 66 or U0%. 
A more detailed report of this survey will be found in Chapter U of 
Volume II of this report. Based on this initial survey, the instrument 
was refined and modified for simplified data processing (Thorp, 1970), 

DEVELOPMENT OF MODEL 

Evaluation can, be described as a means, of providinpj information 
through formal methods (such as criteria, measurement and statistics) 
to serve as rational base for decision making activities (Stuf flebeam, 
1968). The model should, therefore, be concerned with tne collection, 
organization, analysis and reporting of information bearing on the 
effectiveness of the educational television network in the State of 
Georgia (See Chapter 1 for further elaboration of this point). 

Based on detailed analysis, it was determined that the most logical 
approach to achieving these decision making goals was through a systems 
approach. The general systems model takes the form of a flow chart 
or series of flow charts which represent graphically the logical struc- 
ture of the organizational functions of the system. The full evaluation 
model, including systems flow charts, is presented in Chapter 4. 

FIELD TESTING OF SELECTED ELEMENTS OF MODEL 
In order to test selected elements of the evaluation model, a field 
test of two components was made. Field testing was made in order to 
establish the feasibility of large scale use of the model. 

Teacher ITV Questionnaire 

In order to test the feasibility of the use of the revised Teacher 
ITV Questionnaire, a sample of 46 elementary schools was drawn from the 
Georgia Educational Directory (1970). A packet of questionnaires, sufficient 
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to provide one for each teacher, was sent to each school. Teachers in 
29 schools responded to the questionnaires. The remaining 17 schools 
did not receive the ITV television signal, did not have the television 
sets, or did not complete the questionnaires for a variety of reasons. 
Chapter i of Volume il contains a complete description of this study. 
Public Broadcast Survey 

In order to tfst the feasibility of a mass survey of public tele- 
vision viewers in the State of Georgia, the revised Educational Tele- 
vision Questionnaire (see Appendix K) was sent to a sample of the general 
Georgia population. Every 200th name in the telephone directories of 
Atlanta, Albany, Augusta, Columbus, Macon, Rome, Valdosta, and Waycross, 
Georgia was sent a questionnaire. Questionnaires were sent to 2300 homes 
in the Metropolitan Atlanta area, while the remaining cities in Georgia 
received a total of 1700. In addition, 500 names were chosen from the 
WGTV program mailing guide. All persons lived in the viewing range of 
Channel 8, WGTV. A complete analysis of the data obtained from this 
survey is reported in Chapter 4 of Volume II of this report. 

SUMMARY 

This chapter has presented a broad overview of the procedures that 
were used in development of the software for and as a result of the • 
evaluation model. In addition, a brief summary of the pilot testing and 
revision procedures was included. Where possible, field testing of the 
various instruments was accomplished. A brief description of the pro- 
cedures used in the development of the mode has been included. 
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chapter 4 

SPEaPICATIONS CF THE THEORETICAL EVALUATION MODEL 

It is difficult, if not impossible, to precisely define the process 
which resulted in the evaluation model represented in the following series 
of flow charts. The approach was basically one of deduction. The staff 
initially set about gathering information on a variety of topics related 
to the. nature of the problem. Among these data were primarily (1) opinions 
of experts in the field, (2) related research literature, (3) opinions of 
teachers, students, school administrators, and curriculum experts, (U) 
facts about the current operation of GETV as viewed by its own staff. 
As this information was sifted, the major elements, dimensions and variables 
became apparent. These formed the basis of the model and are delineated 
later in the chapter. 

Several theoretical evaluation models, varying in degree of specificity, 
were available for modification and adaptation given the purpose of the 
present project. An extremely abstract model, particularly applicable in 
curriculum evaluation, is that proposed by Taylor and Maguire (1966). A 
paper by Stake (1967),- which is becoming a mini-classic of the evaluation 
literature, also significantly influenced present efforts. The criteria, 
prepared by Metfessel and Michael (1967), useful in evaluating the effective- 
ness of school programs, were also incorporated in the final model. What ' 
resulted from the project was not a final model but a prototype which will 
have to be modified as further exploration, field testing, and experimentation 
takes place. And finallyj, inputs from general systems theory were used 
(Maccia, 1962; Pfeiffer, 1968). Because of the practical problems posed 
by the project and its emphasis on data gathering aimed at decision making, 
the previously cited ideas of Stufflebeam in Chapter 1 were the primary 
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contribution to the model* A number of requirements for the model guided its 
development. These were: 
The model should 

1. Reflect the educational needs of the nation and State of 
Georgia, Not only current, but also projected needs* 

2. Be flexible enough to adapt to changes in objectives and 
composition of the target population involved in ETV 
utilization. 

3. Allow elements to be logically a? vfell as empirically 
related . 

4. Be consistent with what is known about the teaching- 
learning process. 

5. Be consistent with what is known about evaluation. 

6. Be inclusive of or allow for inclusion of all relevant 
variables « 

7. Be abstract yet representational and practical. 

8. Be adaptable to cost benefit analysis. 

9. Be compatible with the reporting system of th-. Georgia 
Department of Education, Division of Planning, Research 
and Evaluation. 

It was not possible to meet all of the criteria just listed • They 
nevertheless did guide the resulting model. Many unanticipated problems 
arose during the developmental stages of model building. For example, 
how does one build flexibility into the model so that opposing requirements 
can be met? Some data needed for decision making are required to be 
gathered every year or perhaps even more frequently. Other data need only 
be gathered once, e.g. how teachers use serials manuals. 



1 

Some ideas reported here have been adapted from Ayers, Johnson, and 
Shearron (1969, pp. 19-20). 
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Just a word or two by way of introduction to the series of flow charts 
which follows. 

These charts were generated as a first approximation to the evaluation 
model and represent the logical structure and. to so.e extent, the tempered 
sequence. The sumbols and terminology used are the standard ones (See 
Banghart, 1969; Cook, 1966; Case, 1969). The usual symbols used and their 
meanings are as follows: 



A rectangle indicates a process on a flow chart. 
Each process may have a flow chart of its own. 



J 



Entrance or exit point from a flow chart. 




An arrow indicates the direction of flow of 
the chart. 



A diamond represents a question (binary decision) 
and IS phrased so that there is a yes or no 
answer. 



The arrows leading from a diamond show 
the alternatives to the decision. 
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Each activity and decision point on each chart has been assigned an identi- 
fication number. The first digit specifies the chart number, and following a 
hyphen, a second set of digits designates the serial placement of that element 
in the sequence within that particular chart. Secondly, the appearance of 
gray shaded areas indicates that an instrument, either final- form or proto- 
"typSf has been developed. 

OVERALL EVALUATION SYSTEM FOR GEORGIA EDUCATIONAL 
TELEVISION NETWORK 

A very general outline of GETV is presented in Figure 4.1. Perhaps 
this figure should have been labeled as dealing with the "operation" of 
the system rather than with "evaluation." Although evaluation activities 
are implied in the symbol 1.5, the chart basically describes the sequence 
of activities in managing and operating a statewide educational television 
network. The review activities of symbol 1-2 have recently been completed 
and have been published (Advisory Commission, 1969). In addition, there is in 
progress within the Georgia State Department of Education, and of necessity 
also in GETV, a review of goals and objectives. It is assumed that approp- 
riate individuals or groups will be designated to undertake the processes 
1.1, 1.2, m and 1.6. Note that 1.5 actually refers to two sub-systems 
which will be described later. An ETV Advisory Committee, composed of 
educational leaders of the state has recently been constituted to provide 
guidelines for GETV. Committee concern will be with major questions of 
use of the network. Guidance for the development of a given series Is 
provided by curriculum specialists. 
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EVALUATION SYSTEM FOR INSTRUCTIONAL PORTIONS OF 
GEORGIA EDUCATIONAL TELEVISION NETWORK 

A general outline for implementing an evaluation system for instructional 
television or the in-classroom portion of GETV is described in Figure 4-2. 
The model could be applied to either the evaluation of a series currently 
being broadcast, or the total science offering, or all ITV broadcasting. 
Process 2.1 would undoubtedly be undertaken by the Executive Director of 
GETV and the Advisory Committee, as would tne decisions called for in 
process 2.^, 2.11, 2.13 and 2.18. The several questionnaires and opinion- 
naires suggested by process 2.3 have been field tested and are available for 
application or modification. Descriptions of their development may be 
found in Chapter 1 of Volume 2 of this report. Note that processes 2.2. 
2.5, 2.6 and 2.12 all refer to new sub-systems. Some question about the terms 
included in process 2.5 might arise. A new series may be developed locally 
or in cooperation with regional organizations. A series may be adopted 
wholesale or adapted to meet the needs of GETV. Adaptation might be 
accomplished through editing, modifying instructional materials sent to 
teachers, expanding content coverage, or supplementary series with locally 
produced tapes. Criteria for decision making in any of the decision blocks ' 
are difficult if not impossible to specify. This is due to the fact that 
requirements for programs, series, audiences, etc., will vary considerably. 
In some cases production quality will be of greatest concern' in others 
perhaps quality of learning outcomes associated with the production will 
be considered most important. Decisions regarding which series to select for 
evaluation (2.10) will involve consideration of age of production, extent 
of content and acceptance by teachers and instructional technologists. The 
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criteria for selecting which series to revise are also difficult to specify 
(2, 14). The model as presented relates primarily to traditional series with 
relatively fixed formats. Where a series employs a continually changing 
format, a new and probably more complex set of criteria will need to be spelled 
out. The five year criterion was quite arbitrary but reflects the best 
"feelings" of local television experts. At process 2,15 another alternative 
probably should be allowed, namely the choice of dropping the entire series. 
Also, if the series is meeting goals, then there is obviously no need for 
process 2,16» 

FIELD TESTING OR REVIEWING A NEW TELEVISION PRODUCTION 

The sub-system described by Figure includes two relatively distinct 
approachesto evaluation. Choice between these will be dictated by such 
considerations as time requirements, financial resoiirces, and availability 
of appropriate personnel. The reader can see advantages and disadvantages 
to either approach. The data based teacher-student would in general be 
preferred if for no other reason than its responsiveness to the actual 
instructional situation and materials. As a first approximation to this 
approach one could collate the systematically gathered opinions of indivi- 
duals with expertise in learning theory, instructional methodology and 
curriculum. Again the importance of the GETV Advisory Committee is seen as 
their collective wisdom is required at 3.2, 3.3, 3.4, and 3.5. Process 
3.6 is just shown to indicate that an alternative to Review or Field 
Testing could be developed. Activities related to sampling of subjects 
for evaluation are referred to in processes 3.7 (which in turn refers to 
another subsystem) and 3.8. It is critical that commitment and cooperation 
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for the entire duration of the evaluation period be obtained from the sample. 
During the field testing of the Instructional Television Questionnaire 
developed in the present project, those schools originally agreeing to parti- 
cipate in a survey later backed out, severely reducing the number of usable 
returns. The effects on both reliability and validity were considerable. 
Administration of the assessment devices suggested by processes 3.16, 3.17 and 
3.21 could be handled by local school personnel. 

For reasons of convenience, however, it might be reasonable to place 
an outside group in charge of administration. Present experience suggests 
that junior eoUtge students cdn be readily trained to adninister such 
instrumenta , relieving teachers and principals of additionally burdensome 
tasks. On the other hand, it was not our experience that junior college 
studenta could be readily and efficiently trained in classroom observational 
techniques t Personnel from the GETV Utilization staff might also be employed 
In the data gathering activities of these three processes. Processes 3,18, 
3.19, 3*22, 3.23, 3.2i*, and 3.31 call for application of appropriate analysis 
procedures. These procedures will almost always be statistical in nature. 
Specific methods cannot be detailed at this time due to lack of knowledge 
of data requirements* It might be worthwhile to consider the application 
of cost^benefit analysis procedures, particularly relative to process 
3*2U (Crane and Abt, 1969; Thomas, 1969). And finally with regard to Figure 
H-3, it should be noted that the review panel (processes 3*27 and 3.29), which 
will probably be selected by the GETV Advisory Committee, should receive 
some training in the review process and procedures and criteria identified 
for decision making. 
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WRITING INSTRUCTIONAL OBJECTIVES 

Turning now to Figure 4-4 we note an outline for writing efficient, 
relevant, and useful educational objectives. The activities and checklists 
stand pretty much on their own. The checklists used in writing the instruc- 
tional objectives have been gathered together in Table 4.1. This sub-system 
was based on original work by Yelon and Scott (1970). 

CONSTRUCTION OF ASSESSMENT DEVICES 

The sub-system of Figure 4-5 is also virtually self-explanatory. It 
was suggested by a PERT chart developed by Cook (1966). It has been already 
demonstrated to lead to satisfactory assessment devices. It is assumed that 
the objectives generated from the activities suggested by Figure 4.4 will 
input into this sub-system. The requirements will of course be dictated 
by the nature of the objectives of the production. An experimental procedure 
was tried out in the present project. Pairs of teachers were given a brief 
overview of the procedures involved in stating instructional objectives. 
They were given copies of Mager's book Preparing Instructional Objectives 
(Mager, 1962) and time was spent with each of the two pairs reviewing the 
requirements of a good instructional objective. The groups then viewed 
two telelessons and generated objectives. These objectives then formed the' 
basis for assessment devices. It was our experience that the objectives, and 
the subsequent devices constructed by the same teacher pairs varied consid- 
erably in quality. A final recommendation will be that this procedure not 
be used. A trained team of specialists would be better than taking classroom 
teachers and trying to turn them into experts. In the future, developers and 
authors of productions should initially provide objectives useful for assessment 
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TABLE 

CHECKLISTS TO ACCOMPANY FIGURE SJ'SCIFYING CRITERION 
QUESTIONS USED IN WRITING INSTRUCTIONAL OBJECTIVES 



Checklist I 

1. Is the general goal a broad statement of something 
desirable and within your subject area? 

2. Is the general goal stated in terms of: 

a. Student behavior? 

b. Ends of instruction? 

3. Is general goal chosen from dependent variables as 
stated in the most feasible system modification? 

Checklist II 

1. Does the description include: 

a. The situation for which the student is being 
prepared? 

b. The type of performance required in that 
situation? 

c. The standards usually used to judge the 
performance in that situation? 

Checklist III 



1. Is the statement in behavioral terms? 

2. Is the stated behavior the closest feasible 
simulation to the behavior required in the 
referent situation? 

Checklist IV 

!• Has one or more of these standards been used 
in writing the criterion? 

a. With these characteristics: 

b. So quickly that: 

1. Exact time? 

• 2. Approximate time? 

a. Limits for unit of time. 

c. According to: 

1. Performance identical to reference? 

2, Performance which approximates charac- 
teristics or meaning of reference? 

d. So well that: 

1. Consequence of product identical in 
characteristics? 

2. Consequence approximates characteristics 
of product? 

Is the stated standard the closest approximation 
to the standard usually used in the referent 
situation? 



2. 
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Checklist V 

1. Is the limit and the standards sufficient: 

a. As prerequisite to learning another performance? 

b. As directly prerequisite to performing in the 
referent situation? 

c. To convince you that the performance is stable? 



57 



Yes 

Yes 
Yes 

Yes 



Yes 
Yes 
Yes 

Yes 
Yes 

Yes 



Yes 
Yes 



Yes 
Yes 

Yes 
Yes 

Yes 

Yes 

Yes 
Yes 



No 

No 
No 

No 



No 
No 
No 

No 
No- 

No 



No 
No 



No 
No 

No 
No 

No 

No 

No 
No 



TABLE 4.1 (CONT) 



Checklist VI 



2. 



1. 



Are the stated conditions the closest feasible 
simulation to the conditions in the referent 
situation? 

Are the conditions those affecting this per- 
formance only? 



Yes 



Yes 



No 



No 



Checklist VII 

1. Are all the statements so clear that one or more 
groups of (a) colleagues, (b) students, or 
(c) any parent or citizen could look at the 
objective and the student *s performance and 
would agree whether the student had performed 
according to the criterion limit under the re- 
quired conditions? Yes No 
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activities. The assessment devices developed „iii primarily be those aimed 
at measuring learning outcomes in the traditional form. Specific procedures 
useful in constructing such devices can be found in any number of measurement 
texts (Gerberich, Green and Jorgensen, 1962; Ahmann and Glock, 1967; 
Swain, 1969; and Payne, 1968). Other kinds of devices can be constructed 
with guidance from such authors as Webb et. al. (1966), Shaw and Wright 
(1967), Oppenheim (1966), and Bonjean, et. al. (1967). Again specific 
requirements (processes 5.4, 5.7 and 5.10) must await detailing of the 
objectives involved. Consideration will be given such variables as item 
format, time available for administration, behavior measured, language, 
etc. A measurement .-.xpert should be involved in making the decision called 
for in processes 5.2, 5.7, 5.10, 5.18, 5.20 and 5.21. 

SUBJECT SELECTION FOR EVALUATION AND 
RESEARCH STUDIES 

A very brief outline of a general approach to sampling of subjects for 
inclusion in evaluation and research studies is presented in Figure 4-6. 
Specific procedures, again, cannot be determined until nature of data 
gathering activity is spelled out. Only after such a decision has been made 
can the sampling units be specified (6.1). ' Many already available lists 
can be used to sample. An excellent source, if the sampling unit is school, 
county o;? other large block, is the Georgia Educational Direcicry . In 
addition, the Division of Planning, Research, and Evaluation has available 
listc of principals and othWl^administrative personnel and can select other 
units from a variety of specifications. Teachers could be identified from lists 
of principals and other administrative personnel, and can select other units from 
a variety of specifications. Teachers could be identified from lists of those 
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Figure 4-6, Sub-systom - Sul^oct Solactton for 
Evaluation and Roaiirch Studita 
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participating in the teacher retiremei-t system. Oene ^ai samples of the public 
can probably best be gathered from telephone directories. Sample size 
(process 6.3) can now be conveniently estimated fron: a procedure outlined by 
Krejcie and Morgan (1970). 

Specific procedures (process 6.U) could be designed by reference to any 
of a large number of authoritative texts (e.g. Parten, 1950; Hansen, Hurwitz and 
Madow, 1953; or Stephan and McCarthy, 1958) or to the overview chart pro- 
vided in Appendix A. The importance of soliciting subject cooperation 
cannot be underestimated. A large number of practical concerns will be 
influencial at this point in the evaluation. Time of year and funds 
available are just two of consequence. 

EVALUATION SYSTEM FOR PUBLIC PORTION 
OF GEORGIA EDUCATIONAL TELEVISION NETWORK 

Another very general outline, this time for evaluation of the public 
broadcasting segment of GETV, is presented in Figure 4-7. Due to the lack 
of formal statements regarding public broadcasting in the state of Georgia, 
the investigators were hard pressed as to the requirements for a design in 
this area. The GETV Advisory committee should probably be most influential 
in several decision-making activities, particularly processes 7.2, 7.5, 7.8 
and 7.9. 'fhe preliminary survey undertaken in conjunction with this project 
did not in general, demonstrate feasible procedures (see particularly Chapter 
U of Volume 2 for description). The major problem, of course, is to secure a 
large enough return so as to have some confidence in the statistics. Perhaps 
a shorter version of the questionnaire printed on an IBM card, and use of item 
sampling (Lord, 1962), rather than people sampling procedures, would signi- 
ficantly improve the return. 
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aur«4-7. Eviluation System For Public Portion of Georgia Educational Television Networic 

iee Sub-Syitem - Subject Selection (Figure 4-6) 
'«e Sub-Syttem - Program Development (Figure 4-8) 
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PROGRAM DEVELOPMENT FOR PUBLIC PORTION 
OF GEORGIA EDUCATIONAL TELEVISION NETWORK 

The lack of specific audience objectives is again felt in attempting 
to outline reasonable program development concerned with public broadcasting. 
A first approximation is presented in Figure U-S. This sub-system begins 
with a review of objectives, moves through a consideration of the develop- 
ment or adoption of a new program or series, to an- assessment of viewer 
opinions, and concludes with open-air broadcasting. Implementation of the 
model must await description of (a) goals of the network, and (b) specific 
objectives for public broadcasting. The need for guidance from an advisory 
group is evident. One of the great problems here rests with the limited 
appeal of a great many programs being broadcast. The philosophy of 
"something for everyone" seems to permeate public broadcasting. Such an 
approach to programming surely has great financial implications. Suffice 
it to say that some resolution of the "goals of GETV" problem needs to be 
made. 
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Figurt4-a Sub Syittm - Program Dwalopment for Public Portion of Georgia Educational Televiiion Network 

^ "Sm Sub-Syctem - Writing Inttruetional ObjectiVM (Figure 4-4) 
E RXC^ Sub-Syitmn - SubM Seieetion (Figure 4-6) 
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Chapter 5 

SELECTED SUMMARY OF FIELD TEST RESULTS AND CONCLUSIONS 

As was noted in Chapter 3, the general strategy employed in this 
project was one characterized by induction. In that regard it perhaps 
would have made more sense to present the evaluation model after the 
results. The research studies, however, were both inputs and outputs 
of the model. This final chapter, therefore, will be concerned with 
a brief summary of the results of pilot and field studies. General 
conclusions will be drawn and comments on the feasibility of the various 
procedures tried out. For detailed presentations of the research design 
and results, the reader is referred to Volume II of this report. The 
general organization of this chapter parallels that of Chapter 3, "Brief 
Overview of Procedures". 

RESULTS OF QUESTIONNAIRE ADMINISTRATIONS 
Sampling Student Attitudes 

Two parallel studies were undertaken. In the first (the Lower Grade 
Study) a twenty item inventory requiring the marking of faces reflecting 
different dispositions were administered to a group of Second grade stu- 
dents (two intact classes, N=82) and Third grade (two intact classes, N=83) 
in the Metropolitan Atlanta area. Preliminary examinations failed to show 
any sex or inter-grade differences. The data were combined. A summary for 
the total 165 students is found in Table 5-1. m examining this table, 
one is first struck by the generally favorable attitudes expressed by the 
students. Uniformity might almost suggest the presence of a response set. 
The high correlation between a positive attitude toward school (item 1) 
and watching television in school (item 3) might corroborate a 
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general "everything about school is ^ood" set. The students are sad when 
the television set is turned off and are quite happy, with perhaps one 
exception, with what they see. This exception being the same teachers week 
after week. The variety on Sesame Street is, of course, one of the factors 
which helped make it successful. 

The upper grade form of the instructional television questionnaire con- 
tained two parts. Part I was composed of 15 yes-no questions, while Part II 
contained 13 free response sentence completion items similar to those used 
by Perrodin (1966) in his investigation of attitudes toward science. The 
general areas covered by the questions were virtually the same as those 
included in the lower grade form. 

This instrument was administered to 89 Sixth grade students (46 males 
and 43 females) in a Northeast Georgia school. Again no sex differences were 
noted and the data combined. A summary of the responses of these students 
to the 15 questions of Part I of the questionnaire is presented in Table 5-2. 
All students indicated that they watched television in school and 90% 
of them liked to watch it. Over 80% indicated that the teacher did pre- 
pare them somewhat for the telelessons. did engage in some post lesson ac- 
tivity and felt they did learn from watching television. A trend toward 
pre and post lesson activity was not confirmed by actual classroom observ- 
ation undertaken as part of another- project. This observation survey was- 
done in conjunction with a sixth grade math series. Approximately 65% 
of the students felt that television did in fact facilitate their school 
work and that educational television helped improve their educational oppor- 
tunities. This last item, upon questioning of the students, „as found to 
be interpreted as indicating that television pointed out topics, areas, 
subjects, ideas that they had not previously been concerned with and stimulated 
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TABLE 5-2 



Por?^r??art ?f ^"^^^ ^^"^^"^^ ^^=^5^ ^° Structured 

Portion (Part I) of Upper Grade Form of Instructional Television Questionnaire 



Frequency 

Yes Response %Jes Question 



80 90 
58 65 

89 100 



19 21 



53 60 



0 0 

'♦9 55 

74 83 

1 1 

2 2 

26 29 

60 67 



1. Do you like to watch television in school? 

2. Do you think that watching television in school 
helps you with your school work? 

3. Do you ever watch television in school? 



19 21 H. 

74 83 5. 



.^^-^n you are at hr>-ne during school hours, do you 
■vor watch the f^^-m-- shows you see in school? 

Does your teacher ever talk about a television 
shov; before you see it? 



6. Do you ever do any of the things that the television 
teacher tells you to do? 



7. Do you like the television teachers? 



79 89 8. 



Does your teacher talk about "a television show after 
you see it? 



9. Do you watch television in school everyday? 

10. Does your teacher ever assign a television program 
for you to view at home. 

11. Do you think think that you learn from watching tele- 
vision in school? 

12. Do you keep a television notebook? 

13. Have any of the television teachers ever visited in 
your school? 

14. Have you done a project as a result of watching a 
television program in school? 

15. Do you think that television in your school has 
improved your educational opportunities? 
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them to sea--.?: c.t iniov^r i. io;: :--:oL:f . Tr . ,c, r '• - , viewing 

of ITV when r.-.^^-.b lo (P!.?.; vbc n'r. i-ncxr. ;-.>:T,i,:. 

A selected .:;..n,arv o.- Llur r.-.r -^r zo .-e r'in>..o.. coi.-.ric-: .on portion 
(Part II) of the Upper Grade. r.s :'.vis i.- v.>estior.n..5re is found 

in Table A 5-3. These data -ojifivni l';c prfV.orr.inatejy positive responses of 
Table 5-2. In general sixth graders view in-school television as truly 
educational, where interesting and new ideas are presented to them. Far 
and away, the most liked program is an upper elementary grade language arts 
program. Cover to Cover , which deals with appreciation in selected children's 
literature. And finally the responses indicate that some students experience 
some preparatory and post lesson classroom activities. 

Sampling Teacher Opinions 

Initially a questionnaire was constructed to gather information about 
the relationship of instructional television to students and to school 
administrators; supplementary materials for use with instructional tele- 
vision; utilization of instructional television, including scheduling pro- 
blems; use of communiques and certain personal data about each respondent. 
The teacher questionnaire contained 44 yes-no items, and a list of 60 
adjectives that each respondent was asked to mark either yes or no depen- 
ding on his judgment as to whether or not the adjective was descriptive of 
instructional television. In addition the questionnaire contained eight 
items of personal information (years of teaching experience, level of 
certification, etc.) and five free response questions such as what programs 
would you like to see aired on instructional television. 

An initial "teacher" form of the Instructional Television Questionnaire 
was pilot tested and revised. 
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TABLE 5- 



Selected Suirn>ary of Responses by Sixth Grade Students (N=89) to 
Sentence Completion Portion (Part II) of Upper Grade Form of Instructional Television 

Questionnaire" 



Percent Item and Illustrative Responses 

TELEVISION IN SCHOOLS IS: 

18% good, V O.K. , fun 

5**% educational and interesting 

16% not exciting, boring, uninteresting 

MY FAVORITE TELEVISION PROGRAM THAT I SEE IN SCHOOL IS: 

78% Cover to Cover 

20% Places in the News 

2% other programs 

WHEN IT IS TIME FOR OUR TELEVISION LESSON: 

*^5% we sit down and listen, pay attention, preparation activities 

21% we watch it 

7% 4e get restless, dislike it 

WHEN OUR TELEVISION LESSON IS OVER: 
W% we discuss it 

16% do other assignments, read, etc. 

9% go to lunch 

I LIKE TO WATCH TELEVISION IN SCHOOL BETTER THAN: 

28% work at written assignments 

19% Social Studies 

12% Spelling 

WE WATCH TELEVISION IN SCHOOL BECAUSE: 

**0% we might learn new things do learn new things 

26% my teacher thinks it is helpful 

10% it is educational and interesting 



**«Note that percents do not sum to 100 as only most frequently 
occuring responses aie summarized. 



O 72 

ERLC 



The revised instrument is a 51 ite. .uUiple choic. questionnaire, with 
ten items devoted to personal data abou. ri.. ,.aoher. The Ul items in the 
questionnaire c.ntor on the general topic, of the relationship of instructional 
television to students, relationship of instructional television to school 
administrators, supplementary materials, utilization of instructional tele- 
vision and instruction and scheduling of instructional television. A copy . 
of this instrument is found in Appendix D of this report. 

A field test of this instrument was conducted with teachers in the 
Spring Of 1970 in schools in the State of Georgia. Schools for field testin. 
were chosen from the alphabetical listing of schools found in the Georgia 
Education Directory (GED) for the school year 1970. Twenty schools were 
selected by drawing every .8th school in the list that did not have classes 
above the ninth grade. This restriction was imposed on the sampling scheme, 
since most instructional television is used in classes below the ninth grade. 
Of the ten congressional districts in Georgia, seven were represented at 
least once in this initial .ample. To increase the reliability, over-all 
return, and to provide for data shortages due to non-respondents, 20 
additional schools were chosen by listin, con,ressional districts not covered 
in the first sampling, and then choosing schools from the GED that were loca- 
ted in these areas of the stated 

Packets of materials were mailed to the principal in each school with 
a request that he distribute the questionnaires to the teachers in his school. 
Return envelopes were provided for each principal. After the initial mailing 
six principals immediately responded that either their schools were not 
equipped for television reception or their teachers did not use television 
because of poor reception. Six additional schools were chosen from the GED 
to replace those that could not or did not receive a television signal. 
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It was ant:.cipated that approximately 640 teachers would be available 
in the 40 schools that were contacted. Eventually 29 schools responded to 
the survey with a usable return of 397 teacher questionnaires. The results 
of this administration of the instrument are summarized in Table 5-4. This 
table presents the mean and standard deviation of the rating for items 1 
through 41 of the instrument. Items 42 through 51 refer to demographic 
data. The data from items 1 through 41 were submitted to factor analysis. 
However, no discrete factors were isolated. In general the- teacher res- 
ponses to the items were below average with most being around 2.50. It 
is interesting to note that the highest mean (3.57) rating for any item 
related to the perceived support that the principal gave to the use of 
instructional television in the school. Lowest rated items tended to 
deal with class related projects supposedly resulting from influence of 
ITV. 

Questions 42 through 49 sought personal information about the teachers, 
while questions 50 and 51 established whether or not the teacher had a 
television set and if she used it in her classroom. The average teacher 
surveyed teaches between grade I'ivels two and five, is female, has been 
teaching more than ten years, holds a bachelor's degree, is certified and 
is between the ages, of 46 and 55. Eighty-six percent of the teachers have 
access to television sets, and 66% use them for Georgia In-School television 
series. 

The results of this study were somewhat disappointing in that there 
was only a 62% return of the questionnaires and the factor analysis of the 
instrument did not reveal a discrete factor pattern. However, the instru- 
ment does lend itself to gathering useful information about the relationship 
of teachers to instructional television. This instrument coupled with the 
instruments described later in this report will help give an overall pic- 
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A 30 item (yes:-N\ ' nj. : .h-:- \^:<, 1 -i/ii^tc-red iy-^ a group 

(N=37) of predominHte'iv -I rr]^-:^; • %C'lrv.)i nrinc ipc';] Tlie content of 
the Principal form of the ITV Qu'^stionnaire parallel «d that of the 
Teacher form. In general the principals felt that there is a strong 
need for additional, materials for use with instructional television 
and for additional training in the use of the medium in the classroom. 
Over 70% of the principals indicated that they recommended instruc- 
tional television at all grade levels and that they were aware of the 
programs that their teachers were using. About 70% felt that the 
communiques were of value to their teachers. However, only ^0% indi- 
cated that their teachers were using the communiques. Only 10% of the 
principals indicated that they were required to use instructional television 
by the superintendent or school board and th^ likewise required their 
teachers to use the medium. Most items received a positive answer, 
averaging about i*0%. A revised form of the questionnaire containing 
53 multiple choice items can be ^ound in Appendix £• 

Sampling Opinions of Cui?riculum Directors and Supervisors 

An opini':>naire (21 items) similar in format and content to the 
Teacher and Principal formers was developed and administered to a 
sample of 3** supervision and curriculum directors who were in atten- 
dance at an in-service course on the campus of the University of Georgia 
during the Winter of 1970. In general, the supervisors felt that there 
is a strong need for additional materials for use with instructional 
television, that their local school superintendent supported the uso 
of instructional television, that instructional televij?\ori is a very 
wrothwhile educational tool and that the programs are up-to-date in 
^ - . 



terms of validity of content. About 67% of the supervisors recommended 
instructional television for all grade levels and felt that teachers 
cooperate among themselves in adjusting th^ir teaching schedules to 
accommodate instructional television viewing, in contrast only about one- 
third of the supervisors indicated that their teachers watched the com- 
muniques and that the communiques were scheduled at an appropriate time. 
A revised form (48 items) of the Curriculum Directors/Supervisors form 
of the ITV Questionnaire is found in Appendix F. 

Sampling Parent Opinions 

In orJer to complete an evaluation of the full spectrum of the popu- 
lation involved in instructional television, a parent questionnaire was 
developed which contained eight yes-no questions. These questions cen- 
tered on the knowledge and attitudes that parents had regarding the use 
of instructional television in school. This instrument was pilot-tested 
with a limited group of parents (N=27) in attendance at a PTA meeting 
at a school in Northeast Georgia. The sample is not represencative of 
any large definable population. The group did serve, however, the pur- 
poses of testing the ease of administration of the instiw-ent and indi- 
cation of the kinds of likely responses. 

It was found that approximately 42% of the parents said that they 
had wstched instructional television (programs presented between the 
hours of 8:30- a.m. and 3:00 p.m. over o^e of the television stations 
operated by the Georgia State Department of Educatior.). About one-half 
of the parents indicated that their children discussed things that they 
saw on television in school" and that they felt Instructional television 
helped their children with homework. About two-thirds of the parents 
indicated that their children watched instructional television between 
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the hours of 8:30 a.m. and 3:00 p.m. when they are at home durinp the school 
year and that they had read one or more articles r-lated to instructional 
television in the last year- About half of the parents Indicated that their 
children were required to watch a television program as a homework assign- 
ment on special occasions. 

It would appear from this very limited sample of parents that they 
are to some extent knowIec^/r.able of the part that instructional television 
plays in the education of their children. It would also appear that par- 
ents are interested in learning more about the use" of this medium in the 
school. 

Appendix G of this report contains a copy of the final form of the 
parents' questionnaire. There have been no revisions made in the question- 
naire. 

EFFECTIVENESS AND IMPACT OF INSTRUCTIONAL TELEVISION 
TEACHER AIDS (COMMUNIQUES AND MANUALS) ON TEACHER BEHAVIOR 

AND STUDENT LEARNING 

The general design of the several evaluation activities associated 
with the investigation of the effectiveness and impact of teacher communi- 
ques and manuals is contained in Chapter 3. Basically the purposes were 
to (a) develop and apply a set of rating scales aimed at evaluating 
various content, organizational and physical aspects of these two types 
of teacher aids, (b) investigate the impact of the aids on teacher know- 
ledge and behavior, and (c) examine student learning under various condi- 
tions of teacher use of the aids. The ultimate aim was to use the resul- 
ting data as inputs into the evaluation model building activity. 

The study was divided into two parts. The first dealt with two tele- 
lessons from the second grade social studies series. Wonderful You . This 
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15 minuto - 33 lesson sex-^ies is intended to guide the child toward a better 
understanding of what is human about man and how he can become more so* 
Specific research efforts in this investigation dealt with two lessons- 
concerned with general problems in city planning and the development of 
the super-capital of Brazil, Eras ilia • Focus in this study was on student 
and teacher learning. The second study used two telelessons from a sixth 
grade discovery math series. Patterns , The lessons, from tne 33 part 30 
minute discovery oriented mathematics series, focused on concepts and 
methods of measuring volume. The focus in this study was on student learn- 
ing and the impact of the manual and communique on pre and post telelesson 
teacher behavior. 

The manuals and communiques and telelesson tapes were studied by 
pairs of experienced teachers* After a brief training in stating behav- 
ioral objectives, the teachers provided sets of objectives for both 
teachers and students. A total of 36 teacher and 25 student objectives 
were generated from the Wonderful You material* Examination of Patterns 
yielded 48 teacher and 36 student objectives. 

Bcised on the objectives derived using the just described procedure 
the following instruments were constructed: 

(a) A 25 item Wonderful You student achievement test based on tele- 
lesson and manual objectives. 

(b) A 20 item Wonderful Ygu teacher achievement test based only 
on the teacher communique objectives. 

(c) A 75 item obsei'vation schedule, the Patterns Observation Summary , 
based on the teacher manual and communique objectives. The cate- 
gories teacher gives, teacher asks, and pupil responds were used 
for each of the 75 objectives, and 

(d) An 18 item Patterns student achievement test based on manual 
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and television objectives. 
In addition 26 item manual and 21 item communique rating, scales wer-e 
constructed. A five point scale (b = Excellent, = Poor) v.^as 

used. 

Teachers and tr^turientc ur.lnp the Wondei^ful You series were identified 
by the Socia] Science Curriculum Director of a large Georgia school system 
and were randomly assigned by teacher to one of three groups; (1) view 
communique only, (2) view communique and study manual, and (3) study 
manual only. Two grups of non-ITV users were also identified, and addi- 
tional groups designated; a (^) no- view no-study group and a (5) student 
view only group-. The final sample sizes are described in Table 3-1. ' 
Teachers in groups 1, 2, 3, and 4 met at the same time. Groups 1 and 2 
viewed the Wonderful You communique, completed a rating form, and took 
the achievement test. Group three teachers completed a manual evaluation 
form and the achievement test. The achievement test was also administered 
to the teachers in Group 4. After students had viewed the two telelessons 
during scheduled broadcast time, the achievement test was administered. 

The groups for the Patterns study were developed in approximately 
the same way as those for Wonderful You . On.: difference being that two 
different school systems had to be used in order to secure large enough 
samples • The final sample sizes are described in Table 3-1. A student- 
view only group was not used in this study as it was felt that the control 
group provided sulficient data for evaluating the effectiveness of the 
three treatment combinations. 

Communique and manual evaluation forms wez^e administered to the appro- 
priate groups of teachers, and student achievement tests given following 
scheduled broadcasts of the two telelessons. In addition, a group of junior 
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college students „as given a brief training session in the application of 
the observation schedule and in test administration. All teachers were 
observed for approximately 30 minutes immediately before and after each 
telelesson broadcast* 

Evaluation of Cn minuniques 

The range of mean ratings (five point scale) for both series communi- 
ques was quite large with^a modal rating of about three. Although quite 
similarly evaluated, the Patterns communique tended to receive higher 
ratings than the Wonderfu^ due to the fact that it 

was considerably more "methods" oriented. Teachers felt that the poorest 
characteristic of the communiques was the scheduled showing time (after 
school), but that both communiques effected organized, accurate, useful, 
informative and helpful presentations, m general, the group who had 
studied the appropriate manual material prior to viewing the communique 
tended to give somewhat higher ratings. 

Evaluation of Manuals 

As with the communiques, the two series manuals tended to evidence 
similar ratings. The majority of the ratings were between three and 
four; It was felt that the material was not at an appropriate level of 
difficulty for the students. High ratings were given accuracy of material, 
adequacy of lesson bibliography, readability and practicalness. It was 
again noted that if a teacher had both viewed the commnique and studied 
the manual, higher ratings tended to be given, particularly with regard 
to practicalness of follow-up activities. The general physical charac- 
teristics (print size, binding, illustration) were rated highly. 
Student and Teacher Achievement - Wonderful Yot i 

Descriptive statistics resulting from the administration of the 
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achievement tests to both teachers and students are summarized in Table 
5-5. It can be seen that the Wonderful You twenty- item teacher achieve- 

TABLE 5-5 

Descriptive Statistics for Teacher and Student Achievement ^Tests 

SERIES 

Wonderful You Patterns 





Teacher 


Student 


Student 


Group 


X 


S 


X 


S 


X S 


1. Communique 


lU.l 


2,3 


lU.l 


2.6 


11.8 2.7 


2. Communique 
and Manual 


1U.7 


3.2 


15.8 


2.7 


8.7 2.6 


3. Manual 


13.3 


3.6 


13.9 


2.5 


11.7 2.6 


U. Control 


12.6 


2.3 


12.0 


2.U 


8.6 2.6 


5. Student 
View Only 






12.9 


2.6 





ment test did not show large differences between groups. This was confirmed 
by a non-significant F-ratio derived from an analysis of variance. It would 
appear, howev^ar, when treatment means are compared with the control, that 
some benefit can be shown to be derived from studying the manual and/'or view- 
ing the communique. The relatively high score of the control group was 
unexpected and might be evaluated as indicating that the test was not as 
specific to the television material as thought. 

Examination of the student test data reveals quite a different ^Acture 
of the impact on student learnings as transf erred^facilitated or translated 
by teachers from the teacher aid materials. The student groups whose 
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teachers studied the manual and reviewed the communique achieved higher 
than the other groups. As might be expected , there is little difference 
between those groups whose teachers had studied only the manual or viewed 
the communique. This eye-ball analysis of the significance of the mean 
differences was confirmed by a five group one-way analysis of variance 
(F = 179.5, d.f. = ^/mQ, P<.01). Subsequent application of Duncan's 
New Multiple Range Test (Kramer, 1956) indicated non-chance significant 
differences between all groups axcept for the manual only and communique 
only groups. 

Student Achievement ~ Patterns 

The means and standard deviations* for the four student Patterns 
groups are found in Table 2. Again a differential teacher-preparation 
treatment effect is noted. The unexpected finding that the communique 
and manual group was not the highest is noted. The students in the manual 
and communique group achieved approximately as expected when compared with 
each other and with the control group. But their superiority ovar the 
communique and manual group was puzzling. Investigation of the manual 
and communique groups indicated that they were composed of definitely 
above average students with respect to both intelligence and achievement. 
These groups, by chance, had experienced considerable exposure to the 
content of the telelesson prior to their involvement in the experiment. 
An analysis of variance was performed which yielded significant results 
(F = 70.63, d.f. = 3/61U, P-COl). Application of Duncan's New Multiple 
Range Test (Kramer, 1956) to the differences between n.eans indicated 
significant differences between the communique only and communique and 
manual, and control group, and between the manual only and communique 
and manual and control groups. There was no signifi^.ant difference between 
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the communique only and manual only or communique and manual and control 
groups . 

Teacher Behavior - Patterns 

Application of Jthe Patterns Observation Summary did not reveal a high 
frequency of teacher pre or post lesson activity that was tied specifically 
to the telelesson objectives. It was expected that the teachers exposed 

■■■*^**-J"^3JiiiaLandyo^ of more activities and po - 

haps utilize more of | them in their classrooms . Although the communique and 
manual group tended p use more relevant activities, no remarkable data were 

I 

observed. It is quite likely that the practical limits of time impose 
res-crictions on teacher preparatory activities. There is always a question 
of reliability of oblervers and the limited sampling of teacher behavior 
taken in this studjf. Whe observation technique, however; would seem to 
warrant further study. ^ 

RESULTS OF PUBLIC BROADCASTING SURVEY 

Recent articles by Siegle^ and Wade2 have provided useful information 
in building an ETV viewer profile. Such a composite would have implica- 
tions for programming,! budgeting, as well as research efforts. Despite 
the methodological flav;s in virtually all surveys of television viewer 
characteristics, a definable picture is emerging. 

The initial intept of the present survey was to pilot test a two 
page (single sheet) 2j2 item questionnaire together with the feasibility 



^Henry J. Siegle, "A Look at the ETV Audience", Educational Broa dcast- 
ing Review . 1969, Voll 3, #5, (October), pp. 23-29. 1 

^Serena E. Wade, j "Another Look at the ETV Audience", Educational Broad- 
casting Review, 1970, Vol. U, #1 (April), pp. 19-21. 
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''-^ " • * - UvfaJ. r. with demo- 

graphic dora anc s-';,-v--;a.i h'-i:-.^«.^ i ^ t-:-*- - • • i. , 

^ ' ' ' ^i"'""*-' ^ ^^i^iv,,Ks i.a.:>tt-- and reasons for 

watching TV. Questic. :^ .n....c . -i- .r-. L... • Ion of the KTV or non-ETV 
viewer groups which rovr.^^ 1•^.e b.Tic .nit. vor analysis. The remainin;, 
questions related to view in. habits, favorite programs; reasons for 
watching ETV, and sources of program information. 

The sampling procedure involved the .selection of apoFS^HlnaTelv 



every two hundredth name (excluding businesses) from Southern Bell 
telephone directories for the eight of ten largest metrooolitan areas 
in Georgia. Atlanta and Athens were not included in the survey as they 
were already being considered in another study. 3 The survey results 
from these two cities closely aoproximte those based on the eighth area • 
survey. A total of 1695 questionnaires together with a cover-letter were 
mailed. Unfortunately, only a 20% return was realized yielding 319 us- 
able questionnaires. Of these approximately 31% of the respondents said 
they or members of their families were viewers of public broadcast tele- 
vision. Proximity of income tax and Census, activity and a. high level 
of political and civil rights tension, to the mailing were judged to 
have adversely influenced the return rate. 

Despite the shortcomings of the methodology just mentioned, the 
following ETV (as contrasted to the non-ETV) viewer profile is offered*. 
The head of the household (consisting of a total of three members) 
where ETV is viewed is approximately 45 years of .age with some 
college training. He is likely to hold a professional or managerial 

Arp;, iwnif- '^''Au A" Audience Survey of WGTV in the Atlanta 

Area Unpublished Masters Thesis (School of Journalism), University of 
Georgia, Athens, Georgia, 1970. ^ 
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position, own his own home, have two cars and a black and white 
and a color TV set, and read several daily newspapers and monthly 
magazines. The non-adjlt members of the ETV viewex-s household 
are likely to be in the 6-12 age group. The ETV household .is 
likely to watch almost four hours of television a day, the 
greater portion of which is public broadcasting. Major reasons 
given for watching television (both public and commercialTwere 
related to relaxation and education. Favorite programs tended 
to be public affairs (Firing Line ), cultural (NET Playhouse )' 
and related to personal interests ( French Chef ). Sesame Street 
was, of course, a big vote getter. 
This profile corresponds closely to others that have resulted from 
cross-national mail surveys, as well as telephone interviews. 

J GENERAL CONCLUSIONS 

It is felt that the data, experience, and knowledge resulting from 
the project warrant the following conclusions: 

l| A comprehensive, flexible, and internally consistent evaluation 
model has been developed which can be effectively applied in 
\ assessing the operation of educational television in the State 
\ of Georgia (See Chapter U). 
In addition to this general conclusion, several specific conclusions 
have resulted from the individual research activities of the project. 

Elementary kids like in-school television. The results confirm 
a uniform general positive attitude which corresponds to Schramm's 
observation for his young student subjects. As one moves up the 
grade scale, some differential attitudes can be observed. 



2. 
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favorably .•i.Lr.rjcst-d tcwa-d ^ r ^ ■ . 

of :'.>i=;lnacticnal tele- 
vision in the Ststs of Georgia 

4. Various physical, consent and or..ani.ational characteristics 
of the televised teacher communiques, and teacher manuals 
used with elementary school level instructional television 
series are positively evaluated, by teachers. 

5. Significant student learning results from instructional tele- 



Vision. 



6. Increased student learning is a function of the nature of 
teacher self -preparatory activity. If teachers study series 
manuals and/or view televised communiques , their students 
learn more than if they do not engage in such activities. 
Although it is not immediately apparent in teachers upon- test- 
ing with a relevant achievement test, there is a differential 
effect on student learning which can be assigned to one or 
both teacher aids-manuals and/or communiques. Perhaps the 
exposure to teacher aids does result in some kind of sensiti- 
zation of the teachers to relevant content and objectives which 
ultimately get translated and communicated to students. 

7. Teachers do not engage in a high frequency of pre or post tele- 
lesson activity with their students. 

8. In general, exposure to two teacher aids is more influential than 
a single aid. 

9. Great care and training is needed in using classroom teachers 
to specify instructional objectives from telelesson video tapes 
useful in the construction of evaluation devices. 
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10* With certain limitations junior ooll«Kt tttt4«ntt can b« utid 

tfi make cUwroom obt«rvationt of toMtMr^studtRt iBtaraatiffl* 
iX* ma of mliH qu«stionnalp«s Is not tb« m§t affaativ* Mthod 

of «ttrv«»ylt>g publia hroadeaat telavlflon vIawIhk 
lit Pai-«nt8 ara modarately knowladgablf about the part played by 

Inatpjctlonal talavision in tha adaption of their children . 

! 
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OVERVIEW or SAMPLING PROCEDURES 



Type of 
Sampling 



T 



Ar^Simple 
Random 



Brief Description 



Advantages 



Disadvantages 



Assign to each popu- 
I latlon member a unique _L. , 
[nuniber; select sample j 
litems by use of random |2# 
I numbers [ 



jl. Requires minimum 



I 



knowledge of popu- t 
lation in ''advance 
Free of possible 
classification 
errors 
-3 V— i^jL.to^^an a]^ze 



data and compute 
errors 



1, Does not make use of 
population which re- 
searcher may have 

2. Larger errors for 
same sample size than 
in stratified sampling 
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System- Use natural ordering 
atic jor order population; 

I select random starting 
i point iDetween 1 and 
Ithe nearest integer to 
jthe sampling ratio' 
j(N/n); select items at 
interval of nearest in 
teger to sampling rati 



11. If population is 
j ordered with re- 
i spect to perti- 

j nent property , 
I gives stratifica- 
i tion effect, and 
i hence reduces 
\ variability com- 
o^ pared to A 

12. Simplicity of 

I drawing sample; 
\ easy to check 



1. If sampling interval 
is related to a 
periodic ordering of 
the population, in- 
creased variability 
may be introduced 

2. Estimates of error 
likely to be high 
where there is 
stratification effect 



Multi- 
stage 
random 



Use a form of random 
sampling in each of the 
sampling stages where 
there are at least two 
stages 



1. With 
probabi- 
lity pro- 
portion- 
ate to 
size 



Select sampling units 
with probability pro- 
portionate to their 
size 



|l. Sampling lists, 
! identification, 
t and numbering 
required only 
j for member of 
j sampling units 
I selected in 
j sample 

\2, If sampling units 
are geographical- 
I iy defined, cuts 
down field costs 
(i.e. , travel) 
. Reduces variabi- 
lity 



!• Errors likely to be 
larger than in A or 
B for same sample 
size 

2# Errors increase as 
number of sampling 
units selected 
decreases 



D. Stratified 
1. Proportion- 
ate 



1. Lack of knowledge of 
size of each sampling 
unit before selection 
increases variability 



Select from every sam- 
pling unit at other | 
than last stage a ran- j 
dom sample proportion- | 
ate to size of sampling) 
unit i 

100 ! 



!• Assures represen- 
tativeness with 
respect to propei?- 
ty which forms ba- 
sis of classifying 
units; therefore 
yields less vari- 
ability than A or 
C 



1. Requires accurate in- 
formation on proportion- 
of population in each 
stratum, otherwise in- 
creases error 



Type of 
Sampling 



2. Optimum 
alloca- 
tion 

3. Dispro- 
portion- 
ate 



E. Cluster 



I Brief Description 



Advantages 



Disadvantages 



Same as 1 except sample 
is proportionate to var- 
iability within strata, 
as well as their size 
Same as 1 except that 
size of sample is not 
proportionate to size 
of sampling unit but 
is dictated by analy- 
tical considerations 
or convenience 



Decreases chance 
of failing to in- 
clude members of 
population be- 
j cause of classi- 
j fication pr- 
*3, Characteri 
! of each stratcun 
j can be estimated, 
j and hence com- 
j parisons can be 
j made 

;i- Less variability 

for some sample 
I size than 1 

More efficient 
than 1 for com- 
parison of stra- 
ta or where dif- 
ferent errors 
are optimum for 
different strata 



j2. If stratified lists 
; are not available, 
I may be costly to 
: prepare them; pos- 
^ sibility of faulty 
classification and 
hence increase in 
; variability 



1. Requires knowledge of 
variability of perti- 
nent characteristics 
within strata 

!• Less efficient than 
1 for determining 
population charac- 
teristics ; i.e. , 
more variability for 
same sample size 



F. Stratified 
Cluster 
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Select sampling units 
by some form of ran- 
dom sampling; ultimate 
units are groups; se- 
lect these at random 
and take a complete 
count of each 



Select clusters at ran- 
dom from every sampling 
unit 



1. If clusters are 
geographically 
defined, yields 
lowest field costs 

2. Requires listing 
only individuals 
in selected 
clusters 

3. Characteristics 
of clusters, as 
well as those of 
population can be 
estimated 

Can be used for 
subsequent samples 
since clusters, 
not individuals, 
are selected, and 
substitution of 
individuals may 
be permissible 



1 . Larger errors for 
comparable size 
than other probab- 
ility samples 

2. Requires ability to 
assign each member 
of population 
uniquely to a clus- 
ter; inability to do 
so may result in du- 
plicates or omission 
of individuals 



1. Reduces variabilis 
of plain cluster 
samplxjg 
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1. Disadvantages of strat- 
ified sampling added 
to those of cluster 
sampling 



1 

Type of 
Sampling 


Brief Description i 


Advantages 


Disadvantages 








2. Since cluster pro- 
perties may change, 
advantage of strati- ^ 
fication may be re- 
duced and make sample 
unusable for later 
research 


G. Repetitive: 
Multiple or 
Sequential 


Two or more samples of 
any of the above types 
are taken, using re- 
sults from earlier 
samples to design later 
ones, or determine if 
they are necessary 


1. Provides es- 
timates of pop- 
ulation charac- 
teristics which 
facilitate effi- 
cient planning 
of succeeding 

coTni^l A ^ lO VI Q — . 
odinpXc , LlicSl^C— 

fore reduces 
error of final 
estimate 

2. In the long run 
reduces number 

! -of observations 
required 


1. Complicates admini- 
stration of field 
work 

2. More computation and 
analysis required 
than in nonrepetitive 
sampling 

*j • mC VJ uc It L xa X oaiii^ xxii^ 

can only be used 
where a very small 
sample can approxi- 
mate representative- 
ness and where the 
number of observa- 
tions can be increased 
conveniently at any 
stage of the research 


H. Judgement 

I. Quota 


Select a subgroup of the 
population which, on the 
basis of available in- 
formation can be judged 
to be representative of 
the total population; 
take a complete count 
or subsample of this 
group 

Classify population 
by pertinent proper- 
ties; determine de- 
sired proportion of 
sample from each class; 
fix quotas for each 
observer 

1 


p.. Reduces cost of 
preparing sample 
and field work, 
since ultimate 
units can be se- 
lected so that 

! they are close 
together 

1. Same as above 

2. Introduces some 
stratification 
effect 


1. Variability and bias 
of estimates cannot 
be measured or 
controlled 

2. Requires strong as- 
sumptions or .consid- 
erable knowledge of 
population and sub- 
group selected 

1. Introduces .bias of 
observers * classi- 
fication of subject 
and nonrandom selec- 
tion within classes 



Source Unknown 
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LO^s'KR Erjf:Hn:7MiY Ga>Ml P(m^ u? STUDENT OPI>r£OimTRE 



"H<v>/ t Kec»I About Tuir-vi^jiuo tn ScUonl 



fiAyj Somo profcftsotb at iho Univeriiliy of Oeoraio arc? tntore8?:r.a 
In how children fodi ^ibout: t:ait3VijUon in ?>alu?ol , I am B-'^ng 
to it?ad yovi *^otnfi (ju<:'^«t Ion*: nhout haw yc?u mlnht f:u«J towijrcl 
tiU;viyilon In school. Then 1 will mik you Ha ^how mo on n 
|Ui|M!r how you f«el, I will not iioo you?: /insu^erc to th^ 
quootiony I react. rUvy vi.H be oent to tho Univeniity, 
££11^1 write your namo oa your papor.'* 

Hnnd out Ct>5t paper to <^ach child. sure each child haa a pi^stcil 
for marking the test. 

Say: "If you are a boy write '^B*' in the box at tha top of vour 

paper. If you are a girl writ<5 a **G^* In the box at che top 
of your paper. You will i^how how you feel by ranrking an 
X (write X ou the board) on the face that :ihow5 ?iow you feel. 
You will n^ark one face for each questlvia that I n^ad. Ba 
sure that you mark thn face for th^i question I nm rc/iding/* 

Sample Ouo ^ i_o iv? 

Dr<w the Coljoving four face.fi on the h.>^rd. 




Say: ''These faces go from very happy (Po.tnt to face on L«ic) 

to less happy (point lo ^.ccond fc^cc from lott) , to rather 
, unhappy (point to ftecond face from ripjit), to very unhappy 
(point to face on right). Mot ice, L\mt On your paper.^, 
there are the same four facs?^ for each nu^nbcr, I will' 
read a ^iucstion to you for each set of ince^ and you put 
an X (point to X which you have drawn on board) on the 
one face in the set that best shows how you feel about 
whot the question is asking. Be &*ure the X covers ^11 
of the face, like thin (drnw an X through one of th^ £ac^/5 
on the board)/* 




Say: "Let's do the aample quofltlons fit tho biiglnning of your 
sheet. Find the £!et of faces next to the letter '^A*" 
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Say: "How do you feel about eating ice cream? Mark an X on 

the face in Set A that best describes how you feel about 
eating ics cream. How many of you marked the very happy 
n^jf R^ise your hands. How many of you marked thTvSy 
unhappy face? Raise your hands." 

Say: ."Go to Set B. How do you feel when you get hurt? Mark 

i f ® ^^^^ feel when you get 

nurtf (Ask for a boy's response and then for a girl's 
response.) ° 

il^rk'^hf'f ^' ^""^ Pl^yi"8 ''ith dolls? 

5na fit 5^?? ^^"^ ^ "^^^"^ f^el about play- 

^ ^e'^haps some of you marked one of the 

middle faces this time to show that you feel less strongly 
about playing with dolls." 

Say: "do you get the idea of how to show ho.; you feel by marking 
one face for each question?" 

sure lu "ad be sure to ocy the number and be 

f^hf i„n^ ~ ^'^'^ "^"^^^"S the set of faces that correspond 

to the number of the question you are reading. 

Use this format for reading each of th= questions: read the 
number of t.h- q-.-stion and then read the q.... ;L"^on. 

Say: "Let's be^in. Find Number 1." 

Kof.?^"^ question n and allow a silent count of four to yourself 
5f vor,r^oJ"^ °" ''i'""'^"" '^2- "'^^^ ^^i"'^ between questions 

M^nc J n "^""^^ ^'-''^ ^''y ^° ^-^^ '^^^^ intervals between ques- 
tions equivalent. ^ 

nil questions have been asked, choose, a child to collect 

all of the answer sheets. 



1. How do you feel about school? 

2. Hdw do you feel about watching television at home? 

3. How do you feel about watching television in school? 

4. How do you feel about learning from television in school? 

5. How do you feel about the television teachers? 

6. How do you think the boys and girls in this class feel about 
television in school? 

7. How do you feel about things the television teacher tells you to do? 



. lOL 



8. How 
thai 



9. How 



10. How 

In 



do you feel about the way your classroom teacher does things 
the television teacher suggests? 

do you feel about seeing the same teachers on television 



eac\ week? 



11. How 



do you think your classroom teacher feels about television 
school? 

do you feel when the television set is turned off in your 



classroom? 



12. How 
and 

13. How 



do you feel about how good your classroom television loolcs 
sounds when it is on? 

do you feel about the things that the television teacher uses? 



14. Howj do you feel when you think about television? 



15. How 



school? 



16.. How 
on 



do you feel about the pictures and drawings that the teacher 
television uses in talking about the lessen? 



17. How 



18. How 



19. How 

20. How 



do you think your mother and father feel about television in 



do you feel about the things (that T. do) (that your classroom 



teacher does) before you watch the television in school? 



do.^you feel about the things (that I do) (tliat your classroom 
teajcher does) after you watch television in school? 

do you feel about the teachers in (your) (our) school? 

do you feel about the questions that you have been asked today? 



CX3 



sO 

vO 

Boy Girl 



Age Grade 
School 



Directions: Below are 15 questions that can be answered either yes or no. 

Please circle what you believe to be the right answer for you. 



with your school work? 

Yes Mo 3. Do you ever watch television in school? 

Yes No When you are at home during school hours, do you ever watch 
the same shows as you see in school? 

Does your teacher ever talk about a television show before 
you see it? 

Do you ever do any of the things that the television teacher 
tells ycu to do? 





Yes 


No 1. 




Yes 


No 2. 






NO 3, 




Yes 


No h. 










Yes 


No 5. 




Yes 


.Ho 6. 


CD 






o 


Yes 


No 7. 






Yds 


No 8. 










Yes 


No 9. 




Yes 




No 10. 




Yes 


No I K 




Yes 


No 12, 




Yfls 


No 13. 



you see it? 

Yes No 9. Do you v;atch television in school everyday? 

Does your teacher ever assign a television f 
to view at home? 



Yes NNo \k. Have you done a project as a result of watching a television 
program in school. 

Yes No 15. Do you think that television in your school has improved your 
educational opportunities. 



Boy Girl ^ 

Age Grade 

School 



Olrecticnst Complete these sentencas with the first thought which comes to you. 



!• Television in school is 



2. My favorite television program that I see in school i! 



3. Our television set 'in school is 



Uhen it is time for our television 1 



esson 



5. When cur television lesson is over 



6, Television lessons are 



7. V/e watch television in rx'iool becaui 



8, A good television lesson _ 
9» Television lessons should 



10. A Qood television teacher is 

11. Television notebooks 



12. I like to watch television in school better than 



I3» Write three sentences in the following space about you and television 
in school. 
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INSTRUCTIONAL TELEVISION QUESTIONNAIRE - TEACHER FORM 



iSiT^i;,!, i ^''^ statement by selecting an appropriate 

DS^^•■ff ! y?"'' °" ^P^^^^l sheet with a soft lead 

Son or „ * possible. If a particular statement does not apply to 

ablt 1?°"? ^^'"^5^°°' °^ y°" honestly feel you cannot make a judgment 

thif Jh? ^° ^"^^ completely before making a new mark. Note 

nu^eSd «T^^f "P ^° y°" "^'^^ ratings to questions 

numbered sequentially across the page from left to right. 

llu^l itr^ seventeen questions on this oplnlonnalre we are asking 
^on«? TT judgments about various aspects of Instruc- 

^onal television. Again note that if a question does not apply to 
^|ou or your situation leave the answer space blank. 

C 

Rate: 1 as noor i _ 

2 _ J °' 3 = average 5 « excellent 

lair 4 a above average 

( > 

^ Relationship of Instru ctional Television to Students 

ll^tlT^lf/ ^f^^''^ '^"^'^ in instructional television lessons 

to the needs of your students. 

projects that your students have developed as a direct 
result of an instructional television program or series. 



P 



orielevl^L^°"'' ^^''^ ^^""^ ^^^^ «^he lessons they see 



Relationship of Tnstructional T elevision to School Administrators 

^* ?n«JrM'^^*'n^°"'' s^^°°^ superintendent gives to the use of 

instructional television in your school system. 

5. Support that your local curriculum director or coordinator gives to 
the use of instructional television in your school system. 

vJs^°rif y"ursL'oJ?^'^^' ^^^^^ ^° °^ instructional tele- 

t 

Supplementary Materials 

^' S^foJ*"? °5 the supplementary materials available for use before and 
after instructional television programs. 

^' 2?^*^S^Lf supplementary materials available for use before and 
after instructional television programs. 



Ill 



Rate: 1 « poor 
2 • fair 



3 ■ average 5 « excellent 

4 * above average 



Utilization of Instructional Television 

9. The advice and assistance that your curriculum director or supervisor 
J is able to give on the utilization of instructional television. 

10. The value of workshops or meetings conducted by the Georgia Educational 
Television Network Utilization staff. (Omit this question if you have 
not attended a meeting within the last twelve months.) 

« • _ 

11. Training you had as an undergraduate in college on the use of instruc- 
tional television. (If you had none, omit this question.) 

Instruction and Scheduling of Instructional Telvision 

12. Format of instructional television programs. 

13. Personality of the television teachers. 

14. Length of the instructional television programs that you use with 
your classes. 

15. Relationship of your scheduled classroom activities with instructional 
television programs. 

16. Influence that your experience with instructional television has had 
on your pursuing additional academic work. 

17. Overall worth of instructional television in the school curriculum. 

We now ask you to shift your thinking to more quantitative questions. 
Questions 18 through 55 deal with aspects of instructional television 
which require Judgments of frequency. A new set of four rating numbers 
is .used. The numbers and their interpretations are as follows: 

Rate: 1 ■ never 3 . usually 

2 " sometimes 4 » always 

Relationshi p of Instructional Television to Students 

18. Do your students keep a television notebook? 

19. Do your classroom tests include items directly related to what your 
students learned from Instructional television? 



20 < 



Do you prepare your students for an instructional television program? 



21. Degree to which you feel it is practical for you to prepare your students 
O . tot a particular instructional television program? 
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Rate: 1 = never 3 = usually 

2 = somsvimes 4 = always 

22. How often do you conduct follow-up activities with your students 
after they have viewed an :r;3cructional television program? 

23. Extent to which you feel that th? cfnU^jit of instructional television 
programs recorraiended for your students is st the .^npropriate grade 
level? ' ° 

24. Do you feel that the presentation of instructional television programs 
recommended for your students is at the appropriate grade level? 

25. Do you think that your students enjoy watchinjj instructional television? 

Re]atjx)nshj^j)f_^^ to School Administrators 

26. Does your principal cooperate with you and your fellow teachers in 
adjusting the overall schedule of the school in order to view 
instructional television? 



IS§l£iict.j-on and Schedal ihg of Instructional Television 

27. Extent to which you find it difficult to organize your classroom 
activities around the instructional television schedules? 

28. Would you like .to be able to repeat having your class view a particular 
instructional television program at a later time after its initial showing? 

''^ Does the present schedule for instructional television interfere with 
the organization of your instructional program? 

30. Do you cooperate with your fellow teachers in adjusting class meetings 
m order to view instructional television programs? 

31. Is the decision to use a particular instructional television series 
made by you? 

32. Is the decision to use a particular instructional television series 
made by your department head? 

33. Is the decision to use a particular instructional television series 
made by your principal? 

34. Is the decision to use a particular instructional television series 
made by a group of you and your fellow teachers? 

35. Extent to which you feel that the programs on instructional television 
are up-to-date in terms of the validity of their content? 

t 

36. Extent to which you as a teacl er, feel that you learn s-.,: '-ci t. 

content as a result of watciiir Instructional television? 
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1 s never 3 = usually 

2 = sometimes 4 = always 

37* Extent to which you feel that you learn teaching techniques from 
watching the television instructor? 

38. Extent to which you tend to organize your classroom activities around 
an instructional television lesson or lessons? 

39. Extent to which you feel that the use of instructional television tends 
to lend structure to your classroom lesson? 

UO. Extent to which you feel that the use of instructional television causes 
you to plan your lessons more closely? 

Ul. Extent to which you think that the instructional television presentations 
are appropriate for the grade level for which they are designed? 

In order for us to make as much sense as possible out of the data, our 
research staff would like to obtain some information about the questionnaire 
respondents. 



Persona.! Data and Use of Instructional Television 



^2. If you did not use instructional television last year, but are using 
it this year, why? 

1) set not available last year but available this year. 

2) first year of teaching school. 

3) felt that shows last year were not appropriate for group I taught. 
**) could not schedule shows. 

5) unaware of how to use instructional television. 

^♦3. If you used instructional television last year but you are .not using 
it this year, why? 

1) set not available. 

2) cannot schedule appropriate programs for class. 

3) feel that it is a waste of time. 

cannot integrate programs into the curriculum that I am teaching under. 

Principle grade level that you teach. 

.1) K or 1 

2) 2 or 3 

3) U or 5 
6 or 7 

5) 8 or above 
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45. Your sex. 

1) male. 

2) female 

46. Number of years that you have been teaching including this year. 

1) 1 

2) 2 to 3 

3) 4 to 6 

4) 7 to 10 

5) more than 10 

47. Your present level of certification. 

1) T-4, B-U, or XB-4 

2) T-5, B-5 

3) TS-6 

4) Other 

48. Highest college degree or cei->tif icate held. (Check only one.) 

1) Bachelor's 

2) Master's 

3) Specialist (6th year) 

4) Doctorate 

5) None 

49. Your age. 

1) Under 25 ' 

2) 26-35 

3) 36-45 

4) 46-55 

5) Over 55 

50. Do you have a TV set in your classroom or access to a set? 

1) Yes 

2) No 

51. Do you use it for Georgia In-School television series? 

1) Yes 

2) No 

If you at present or have at some time used telecourses or telecourses 
and the communiques that accompany the series, please answer the following 
questions. If not return your answer sheet to the person designated by 
your principal. Many thanks! 

52. How many series do you use? 

1) 1 

2) 2 

3) 3 

4) More than 3 
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53. How many IVJ t:?.lr;lrc^%,^9 (iricluding repoai:«) do you use during an 
average school Wriok? 

1) One 

2) Two 

3) Three 

4) Four 

5) Five or more 

54. To what extent do you generally use a ^:erles'? 

1) on a weekly basis 

2) In two or more lesson units 

3) selected programs only 

55. To what extent do you presently view the communique related to ETV 
series you ust? in your classroora? 

1) Not at all 

2) Occasionally 

3) Most of the time 

4) All the time 

56. If you do not view the communique at present time, how long has it 
been since you used nhom? 

1) Never used them 

2) The first year I used the series only. 

3) The first several years I used the series. 

Questions 57 through 61 are in the form of statements. Please rate each 
statement according to the following scale: 

1 ~ Poor 3 = Average 5 =^ Excellent 

2 Fair 4 = Good 

57. The extent to which' the communique will aid you in your classroom teaching. 

58. Organization of the communique. 

59. Ability to incorporate teaching techniques suggested by the communiques. 

60. Format of communiques. 

61. Overall worth of the communiques. 

For the following question just select the alternative that best expresses 
your feeling. 

62. Please suggest, what you feel to be the most appropriate time for you 
to view the communiques. 

1) Before school (in the A.M.) 

2) During school hours. 

3) At the time they are presently aired. 

4) Evening hours (after 7:00 p.m.) 

5) Saturday 
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^ ^ Mndpal Pom 

' ^ EVALUATION OF INSTRUCTIONAL TELEVISION 

I Uf 

The University of Georgia in cooperation with the Georgia State 
Department of Education is developing a model for the evaluation of 
the Georgia State Educational Television Network. In order to help us 
design and develop this podel, we would like your opinion and ideas 
about how instructional television is used in your school. In.trudtional 
television is broadcast Monday through Friday between the hours of 
8:00 a.m. and 3:00 p.m. on one of ten television stations operated 

'• --or leased by the Georgia State Department of Education. Attached you 

C'") 

- • will find a brief questionnaire that has been developed for youf 
^, -particular, group, that is, principals, teachers, supervisors, parents, 
("••;;phildren, etc. This data gathering device is the first of several 
C>hat are being developed. All information will remain confidential and 
will be used for statistical purposes only. We appreciate your ihatlng 
, Mith us yorur real feelings and honest answers to all question*. 

Br* 
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INSTRUCTIONAL TELEVISION QUESTIONNAIRE - PRINCIPAL FORM 

yorr'cho' e orSrs^^cla!"' "''T"' u"'^^""^ ^" appropriate number. Mark 
your cnoice on the special answer sheet with a soft lead pencil if at all nossThlA 

feel Z cTol 'T'"'^'/"'' ^PP'^ ^° °' «'^"-"°n: ^r ylu hon" J y* 

you wHS to^San^e ! ^pJ? «P«" that item blS? If 

2o?e tSt an f ^ '° ^'^^ completely before making a new mark 

IZeXnl'^T^V;^^^^^^^^^^ ^^V:^ - ~ - -estion number 

jomfe%fi::t^:n;^^^^^^^ 

l-TJr 3= average 5 = excellent 

^ rair 4 = above average 

Relationship of Infi^ ructional Television tn SM.Hanhc 
y . the\^"S: 0I ;oui"t^:::t1: ^^^-^^^ ^" instructional television lessons to 

2. The outside projects that your students have developed as a direct result 
of an instructional television program or series. ^ ° ^ " '^^^"^'^ 

^* ^SevJsio!!^' ^""'^ ^^""^ ^""^ '^h^y ««« °n 

Relationship of Instructional Television t o School Adm^n^«^r.^..c 

4. Support that your local school school superintendent gives to the use of 
Instructional television in your . school system. tne use of 

^* teUvL\^^f ^""'^ f ^""'^ Slves to the use of educational 

television In your school system. 

6. Support that your local curriculum director or coordinator gives to the 
use of instructional television. ^ 

Supplementary Materials 

7. Quality of the supplementary materials available for use before and after 
instructional television programs. " ^^^"^^ 

y ^* ?nS^.l'M°^ supplementary materials available for use before and after 
/ instructional television programs. »j.Ler 
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3 = average 5 = excellent 

4 = above average 

Utilization of Instructional Television 

9. The advice and assistance that your curriculum director or supervisor is 
able to give your teachers on the utilization of instructional television. 

10. The value of workshops or meetings conducted by the Georgia Educational 
Television Network Utilization staff. (Omit this question if you or your 
teachers have not attended a meeting within the last twelve months.) 

11. Training you had as an undergraduate in college on the use of instructional 
television. (If you had none, omit this question.) 

3r 

^ nstruction and Scheduling of Instructional Television 

12. Fori at of instructional television programs. 
^ 13. Personality of the television teachers. 

14. Length of the instructional television programs that are used by your 
teachers . 

15. Relationship of your school's scheduled activities with instructional 
television programs. 

16. Overall worth of instructional television in the school curriculum. 

Communiq.ue 

17. Extent to which the tfeachet^ communiques aid your teachers in the classroom.* 

18. Organization of the communiques. 

19 . Format of the communiques . ' 

20. Overall worth of the communiques. 

21. Scheduled viewing times of the communiques. 



Rate: 1 = poor 
2 = fair 
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31. 

32. 
33. 
34. 
35. 



We now ask you to shift your thfnklng to more quantitative questions. Questions 
through 45 deal with aspects of Instructional television which require iudgments 
of frequency. A new set of four rating numbers is used. The numbers and their 
interpretations are as follows: 

^^t^'- 1 = never 3 = usually 

2 = sometimes 4 - alv/ays 

Relationship of Ins tructiona l Tel evision to Students 

22. Do students in your school keep telovision notebooks? 

23. Do your teacher's classroom tests include items directly related to what 
their students learned from instructional television? 

24. Do your teachers prepare their students for an instructional television 
program? 

25. Degree to which you feel it is practical for your teachers to prepare their 
students for a particular instructional television program? 

26. How often do your teachers conduct follow-up activities with their students, 
after they have viewed an instructional television program? 

27. Extent to which you feel that the content of instructional television 
programs recommended for your students is at the, appropriate grade level? 

28. Do you feel that the presentation of instructional television programs 
recommended for your students is at the appropriate grade level? 

Instruction and Sche duling of Instructional Television 

29. Do you feel that your teachers would like to be able to repeat having a 
class view a particular instructional television .program at a later time 
after its initial showing? 

30. Does the present schedule for instructional television interfere with the 
organization of your instructional program? 

Do your teachers cooperate with one another in adjusting their class 
meetings in order that their students may view instructional television 
programs? 

Is the decision to use a particular instructional television series in your 
school made by you? 

Is the decision to use a particular instructional television series in your 
school made by each individual teacher? 

Is the decision to use a particular instructional television series in your 
school made by your department heads? 

Is the decision to use a particular instructional television series in your 
school made by your curriculum coordinator? 
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36. Extent to which you feel that the programs on instructional television are 
up-to-date in terms of validity of their content? 

37. Extent to which you feel your teachers learn subject matter content as a 
result of watching instructional television? 

38. Extent to which you feel your teachers learn teaching techniques from 
watching the television instructor? 

39. extent to which you feel that your teachers organize their classroom 
activities around instructional television lessons? 

'fO. Extent to which you feel that the use of instructional television tends 
to lend structure to the classroom lessvon in your school? 

^*1. Extent to which you feel that the use of Jn.^3lructional television causes 
your teachers to plan their lessons inoro closely? 

42. Extent to which you feel that the inslructlonaJ television presentations 
are appropriate for the gradG leve'l for v/hich they are designed? 

Relationship of Instructional Te levision to 
Parents and PTA Groups 

43. Do parents of your students ever discuss instructional television with you? 

44. Does your PTA ever discuss the use of instructional television? 

45. Does your PTA ever give financial aid toward the purchase of materials or 
equipment related to instruction via television? 



In order for us to make as much sense as possible out of the data, our research 
staff would like to obtain some information about the questionnaire respondents. 
Would you take a last few minutes and answer the following questions? 

46. Your sex. 

1) male 

2) female 

47. Your age. 

1) Under 25 

2) 25-35 

3) 36-45 

4) 46-55 

5) Over 55 

48. Number of years you have been a principal, including this year. 

1) 1 

2) 2-5 . - 

3) 6-10 

4) 11-15 

5) more than 15 j^22 



49. Highest college degree or certificate held. (Check only one.) 

1) Bachelor's 

2) Master's 

3) Specialist (6th year) 

4) Doctorate 

50. Major teaching experience, while a classroom teacher. 

1) elementary grades 

2) junior high grades 

3) senior high grades 

51. Number of teachers in your school 

1) less than 10 

2) 11-15 

3) 16-20 

4) 21-25 

5) more than 25 



52. 



53. 



Number of television sets available in your school 



1) 0 

2) less than 3 

3) 4-8 

4) 9-15 

5) more than 15 



Is your school primarily considered an 

1) elementary school 

2) elementary.junior high school combination 

3) elementary.junior high-senlor high school combination 
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y ALi-^^^^i^ r Curriculum Directors 

Supervisors Form 

> 

. o 

EVALUATION OF INSTRUCTIONAL TELEVISION 

The University of Georgia in cooperation with the Georgia State 

Department of Education is developing a model for the evaluation of 

the Georgia State Educational Television Network. In order to help 

us design and develop this model, we would like your opinion and 

ideas about how instructional t(ilevision is used in your school 

system. Instructional television is broadcast Monday through Friday 

©IP 

^^between the hours of 8:30 a.m. and 3:00 p.m. on one of ten television 
^'^stations operated or leased by the Georgia State Department of Educa- 
tion. Attached you will find a brief questionnaire that has been 

CO 

^'^^eveloped for your particular group, that is supervisors, principals, 

o 

teachers, parents, children, etc. This data gathering device is the 

first of several that are being developed. All information will 

^^remain confidential and will be used for statistical purposes only, 
r « 

^M^We appreciate your sharing with us your feelings and honest answers 
to all questions. 
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INSTRUCTIONAL TELEVlhilON QUESTIONNAIRE - SUPERVISOR FORM 



Directions : Please rate each statorp.*---!!! by selecting an appropriate number. Mark 
your choice on the special answer sheet with a soft lead pencil if at all possible. 
If a particular statement does not apply to you or your situation, or you honestly 
feel you cannot make a judgment about it, leave the space for that item blank. If 
you wish to change a rating be sure to erase completely before making a new mark. 
Note how the answer sheet is set up so that you make ratings to questions number 
sequentially across the page from left to right. 

In the first nineteen questions on this opinionnaire we are asking you to make 
some evaluative judgments about various aspects of instructional television. 
Again note that if a question does not apply to you or your situation leave the 
answer space blank. 

Rate: 1 = poor 3 = average 5 = excellent 

2 = fair 4 = above average 



Relationship of Instructional Television to Students 

1. Relevance of subject matter covered in instructional television lessons to 
the needs of your students. 

2. Outlook that your students have each week for the lessons they see on 
television. 



Relationship of Instructional Television to S^nool Administrators 



3. Support that your local school superintendent give to the use of instructional 
television in your school system. 

4. Support that your local school board gives to the use of instructional 
television in your school system. 

5. Support that your local principals give to the use of instructional 
television* 

Supplementary Materials 

6. Quality of the supplementary materials available for use before and after 
instructional television programs. 

7. Quantity of the supplementary materials available for use before and after 
instructional television programs. 

Utilization of Instructional Television 

8. The value of workshops or meetings conducted by the Georgia Educational 
Television Network Utilization staff. (Omit this question if you or your 
teachers have not attended a meeting within the last twelve months.) 

9. Training you had as an undergraduate in college on use of instructional 
television. (If you had none, omit this question.) 
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Rate: 1 = poor 3 = average 5 = excellent 

2 = fair H = above average 

Instruction and Scheduling of Instructional Television 

10. Format of instructional television programs • 

11. Personality of the television teachers. 

12. Length of the instructional television programs. 

13. Overall worth of instructional teJevision in the school curriculum. 

lU. General relationship in your system of school's scheduled activities with 
instructional television programs. 

Communiques 

15. Extent to which the teacher communiques aid your teachers in the classroom. 

16. Organization of the communiques. 

17. Format of the communiques. 

18. Overall worth of the communiques. 

19. Scheduled viewing times of the communiques. 

We now ask you to^shift your thinking to more quantitative questions. Questions 20 
.through 39 deal with aspects of instructional television which require judgements 
of frequency. A new set of four rating numbers is used. The numbers for their 
interpretations are as follows: 

Rate: 1 = never 3 = usually 

2 = sometimes H = always 



20. 



Relationship of Instructional Television to Students 
Do students in your school system keep television notebooks? 



21. Do your teachers prepare their students for an instructional television 
program? 



22. 



23. 



2H. 



Degree to which you feel it is practical for your teachers to prepare their 
students for a particular instructional television program? 

How often do your teachers conduct follow-up activities with their students, 
after they have viewed an instructional television program? 

Extent to which you feel that the content of instructional television 
programs is at the appropriate grade level? 
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Rate: 1 = never 3 = usually 

2 = sometimes 4 = always 



Instruction and Scheduling of Instructional Television 

25. Do you feel that your teachers would like to be able to repeat having -a 
class view a particular instructional television program at a later time 
after its initial showing? 

26* Does the present schedule for instructional television interfere with the 
general organization of the instructional program in your school system? 

27. Do your teachers cooperate with one another in adjusting their class 
meetings in order that their students may view instructional television 
programs? 

28. Is the decision to use a particular instructional television series in 
your schools made by you? 

29. Is the decision to use a particular instructional television series in 
your schools made by each individual teacher? 

30. Is the decision to use a particular instructional television series in 
your schools made by each individual principal? 

31. Extent to which you feel that the programs on instructional television 
are up-to-date in terms of the validity of their content? 

32. Extent to which you feel your teachers learn subject matter content as a 
result of watching instructional television? 

33. Extent to which you feel your teachers learn teaching techniques from 
watching the television instructor? 

34. Extent to which you feel that your teachers organize their classroom 
activities around instructional television lessons? 

35. Extent to which you feel that the use of instructional television tends 
to lend structure to the classroom lesson in your school? 

36. / Extent to which you feel that the use of instructional television causes • 

your teachers to plan their lessons more closely? 

37. Extent to which you feel that the instructional television presentations 
are appropriate for the grade level for which they are designed? 



Relationship of Instructional Television to Parents and PTA Groups 

38. Extent to which PTA groups in your school system devote time to instructional 
television and its use in the schools? 

y 

39. Do PTA's in your school system give financial aid toward the purchase of 
materials or equipment related to instructional television? 
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I. ,Vf ""^^^ "'"'^^ ^•'""^ as possible out of the data, our research 

staff would like to obtain some information about the questionnaire respondents, 

would you take a last few minutes and answer the following questions? 

AO. Your sex. j 



1) male 

2) female 

Al. Your age. 

1) Under 25 

2) 25-35 

3) 36-45 

4) 46-55 

5) over 55 



42. 



Number of years you have been a curriculum specialists or coordinator 
including this year. 



1) 1 

2) 2-5 

3) 6-10 

4) 11-15 

5) more than 15 

43. Hl{;hest college degree or certificate held. (Check only one.) 

1) Bachelor's 

2) Master's 

3) Specialist (6th Year) 

4) Doctorate 

44. Number of years you were a classroom teacher. 

1) less than 3 

2) 3-6 

3) 7-10 

4) 11-15 

5) more than 15 

45. Number of years you were a principal. 

1) 0 

2) 1-3 

3) 4-6 

4) 7-10 

5) more than 10 



1 
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Approximate total number of pupils in your school system. 

1) less than 1000 

2) 1000 - 3000 

3) 3000 - 6000 

4) 6000 - 20,000 

5) more than 20,000 

Number of elementary schools in your school system. 

1) less than 5 

2) 5-10 

3) 11-20 

4) 21-50 

5) more than 50 

Number of elementary schools in your school systems equipped with 
television sets. 

1) less than 5 

2) 5-10 

3) 11-20 

4) 21-50 

5) more than 50 



I 
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Instructional Television aucationnaire — Parent Form 

Date: _ ^P^^ ^^^^^ 

How many children in your family 

Please indicate the grade Jcvel and school each child attends 



wPlease circle either yes or no for each question. 

rjesNo 1. Do you ever watch what is presented on one of th3 television 

?i ^^"^ operated or leased by the Georgia State Department of 
^ Education between the hours of 0:30 a.ml and 3:00 p^m.? 

Yes Ho 2. Docs your child(ren) ever spontaneously discuss a program 
or programs he has seen in school? ^ ^ 

^^es No 3. Do you.foel that instructional television helps your child 
With his ncr.3worc? 

o 

Yes IJo k. Have you attend^^d any school related meetings in the last 
year at which instructional television was discussed? 

ries No 5. Have you attended any school related meetings in the last 
6^ year at which an individual from the Georgia State Department 

Of Education spoke on instructional television in the schools? 

Yes No 6. Have you read any articles in the lest year, in either newsl 
papers or magazines, devoted to instructional television? 

Yes Mo 7. ?° yp^^'-^f i Idren ever watch instructional television between 

JuriSn 2'^? 3*°° P-'"* "f^^" ^^''y ^""^ at home 

during the school year? 

Yes No 8. Are your children ever required to watch a television program 
as a homework assignment? ' ^' 

9. In the remaining space and on the back of this sheet, please 
suggest any additional questions that you believe shSuld 
be included on future editions of this questionnaire? 
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sO 

o 

•fl Q COMMUNIQUE EVALUATION FORM 

1 ^ 

Name of Communique: 



Date Seen: 



Direction s: Please rata each s♦•af■pm-n^ ^4 

Z^T^^^ZTZ U I cdcii b^acemv-nt by seise tine an app"»-ooriatP 

p'cS* If ^fjr; ''Jm' ^^^'^'^^ wiUh^a soff lead 

you or JLr s?iia?Jo "u" Particular statement does not apply to 

abL^^^ ? J honestly feel you cannot make a judgmsnt 

f r^^ 'u ^ ^P^" 'h^' ite" blank. If you wish to change 

n„™LS^ f f?*" ^° '^hat you n3ke ratings to questions 

numbered sequentially across the page from left to right. "^"^^"^"^ 

2.1 llll J " Average 5 = Excallcnt 

^ 4 = Above Average 

^ teacMng?' conununlque will aid you In your classroom 

^ , 2. Effectiveness of presentation. 

^ , s^:u"^Lch^:rfit."?^o:/'^^^"" — ^'^^ - 

4. usefulness of Information provided by the communique. 

5. Clarity of communique objectives. 

6. The effectiveness of the format of the communique. 
7-. Organization of the communique. 

CT^ 8. Extent you feel that you will be able to Incorporate the suecested 
teaching techniques into your classroom. suggested 

9. Scheduling of this particular communique. 

10. Accessibility of resources suggested in this communique. 

11. Value of guest lecturer or presenter (if applicable). 

12. Practicalness of television teacher suggestions. 

13. Emphasis and amount of time given each lesson covered in the communique. 

14. Accuracy of material presented in communique. 
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wL^n^^f^?^ following statements numbered 15-20 indicating your 
Judgment of the extent to which the communique 

15. will directly contribute to the subject matter of your class. 

16. will enrich the instructional program of your class. 

17. will help you stimulate student interest in the subject. 

18. contains materials usable for follow-up activities. 

^'""^^"^ « "^'^^^ that will help students 
JrogJaL °' «"ti" series of instructional television 

Itlu^^^l you^structure content in a manner that x.lll help students 
realize the objectives of the course 

^^nJ^irjJ** °f communique in terms of the time that you 
spent watching it. ' 

i^achS!^ Instructional strengths of the television 



tea^hS?' instructional weaknesses of the television 



24. What other questions do you feel should be added to this 



questionnaire? 



- ! 
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mmM. LESSOH EVALUATION FORM 



Name of Manual: 



Lesson Number: Pate* 

DlrectJons : Please rate each statement by sel^-tiro aonro- v••a^o 
number Mark your choice on the special ;n;:lrsh'2t'-;ith''a Slfl^.d 
pencil If at all possible. If a particular statement doP.o not aprlj to 

Ibout'ir? r" '^^^ ^ judgment 

about it. leave the space for that item blank. If yon wish to ch'npc 
a rating be sure to erase completely before making a new mark. Not.-' 
that the answer sheet is set up so that yo-.'. n:l<e ratings to questions 
numbered sequentially ^cross the page from .leff to right. 

^ l-lT±l 3 = Average 5 = Tixcellent 

^ 4 = Above Average 

^ 1. Comprehensiveness of inforaation in manual 
available for teaching. 



2. Unity of lesson ideas. 



^> 3. Degree of correlation oi: lesson ;^rith state 
textbook guides. 

Cj 

4. Suggestions for follow-up exercises after each lesson. 

5. Practicalness of follow-up exercises. 
Jp? 6. Suggestions for pre~televislon exercises. 
£h 7. Practicalness of pre-television exercises. 

8. Availability of materials and/or equipment required 
for follow-up exercises. 

9. Availability of materials and/or equipment required 
for pre- television exercises. 

10. Appeal of lesson content to studeftts. 

11. Level of difficulty for students. 

12. Adequacy of lesson bibliography. 

13. Articulation of this lesson with related lessons. 

14. Definitions of new and unfamiliar terms. 

15. Accuracy of lesson material. 
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16. Readability of lesson niciterlal, 

17. Adaptability of lesson material for classroom use, 

18. Adequacy of Illustrative material. 

t 19. Usefulness of appendix and supplementary materials. 

20. Integration of Illustrative material with text. 

The following six quasuions deal with various characteristics of the 
entire program manual. 

21. General physical appearance of manual. 

22. Convenience of left hand binding. 

23. Adequacy of print size and type. 

24. Use of center and side headings. 

25. Size of manual (outside dimensions). 

26. Type of binding. 
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cai 

I i 

Observer 
School 



PATTERNS OBSERVATION SUMMARY 



Teacher 

Date 



Time Begin Observation 



Time End Observation 



Objectives l ^ 52 deal with content of telelesson 30- 



1Q( 


Teacher 
Gives 


Teacher 
Asks 


Pupil (s) 
Responds 


C 1. Unit of measure must be the same 
^ unit as the thing being measured 








Measurements are expressed by numbers 









Qi. Measurements are approximate 










4. The smaller the unit of measure 
chosen, the more precise the 
measurement 

&=5 ^ 








5. Definition of space figure 








6. Examples of space figure 








7. Definition simple closed surface 








8, Examples of simple closed surfaces 








9» Pointing out of Interiors of 
simple closed surfaces. 
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Teacher Teacher Pupil (s) 

Gives Asks Responds 



10* Examples of different plane regions 
which can be visualized as simple 
closed surfaces 








11. Different plane regions cut out to 
show how simple closed regions can 
be constructed from them. 








12* Definition of 3-D space region 








1^. Examples of 3-D space regions 








14. Definition of unit space region 








15. Definition of volume 








16. Differences between 2 approaches 
to study of geometry introduced 








17. Similarities between the 2 

approaches to introducing the 
study of geometry 








lo. using arbitrary unit of length 
(e.g. string) count off measure 
of a one-dimensional line 








19. Measuring area of 2-D plane 

region by placing square units 
of uniform sice on given plane 
region and counting number of 
square units necessary to cover 
plane region 
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Activity comparing volumes of 
different size bottles: 


Teacher Teacher Pupil (s) 
Gives Asks Responds 


20. Arrangement and numbering of bottles 








21. Listing in descending order 
six bottles having largest 
volume 








22. Poll to determine which eight 
bottles have greatest volum^.s 








23. "Finalist" bottles placed in 
full view of class 








24. Deciding which bottle is 

largest, next largest, etc* 








25. Selected bottles are lined up 
in descending order 








26. Largest bottle is filled with 
water or sand 








27t Contents of largest bottle is 
poured into next largest bottle 
on down until descending order 
is determined 








28. Lists are checked 








29. Principle from experiment 








Activity in estimating volumes 
fruit jars of same size by using 
various unit space regions : 








30. Students are paired 


^1. Jars" filled with various units 
space regions (peas, beans , 
sand, marbles) 
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Teacher Teacher Pupil (s) 

Gives Asks Responds 



• i. Awii sji. iiLuuuci or unit space 
regions in different jars 








33, Discussion of estimation made by 
each pair of students 









34 • Estimation of unit space 
regions J a each jar 








jj* rxnamg or most etticient way of 
estimating content of jars with- 
out counting each unit space 
region 


! 




-J 


36 • Estimating by counting ntimber 
of items cap or top of jar will 
hold and counting number of tops- 
ful that will go into jar 








J/ • iit>tiiuating Dy emptying Jar and 
covering bottom with items, if 
jar is relatively straight. 
Using one item to see how many 
times it will fit up the side 
of the jar. 








38. Estimating by another method 
other than number 38 








39. Opportunity for each pair of 
students to measure at least 
3 jars containing different 
unit space regions 






— 


39a. Discussion of Principle from 
experiment" 








40. Conclusion hoped for is no 

one wants to measure jar with 
^ sand 
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Teacher Teacher Pupil (s) 

Gives Asks Responds 



41. Conclusion that jars with 

smaller items hold more items 
than jars with larger items 








42. Conclusion that smaller the unit 

»»»cc»oLiic uiic cxooci Lne approxi** 
mation of the volume of the jar 








43. Conclusion that volume may be 
measured by multiplying the 
number of items in layer by 
number of layers 






• 


Worksheet activity 








44. Various size vases on worksheet 
are examined 




45. Students guess which of vases 
will hold most water 








46. Discussion of all choices 








47. Questions listed at end of 
manual are asked: At what 
point would water be in each 
of these vases if the vases 
were half full? 








48. Question: At what point would 
the water be in each of the 
vases if the vases were a 
ciuartpr full*? 








49. Question: Is half the height 
of the vase the half way point 
on all the vases? 








50. Students mark half way point 
on each vase 
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Teacher 

urxves 


Teacher 
Asks 


Pupil (•) 
Responds 


51. Other questions asked 








52 • Principle of experlement 








Objectives 53 - 75 deal with content of telelesson 31, 






Discussion of whether unit of length, 
unit of area, or unit of volume wou.V 
be used to determine measures of 
various space figures such as thes<. 
listed: 

Teacher 
Gives 


Teacher 
Asks 


Pupil (s) 
Responds 


53. Size of schoolroom floor 








54. Length of curtain rod 








55. Amount of Ice that can fit In 
picnic Ice chest 








56. Size of gas tank In school bus 








57. Size of a mirror 








56. Size of a desk drawer 








59. Size of a packing carton 








60. Height of a door 








^61. Size of a chalk box 
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Teacher Teacher Pupil (s) 

'Gives Asks Responds 





o^. other (indicate number of other 
examples) 






Demonstration of way estimate 
volume of space regions in 
following way: 








63. Bottom of space figure is filled 
with unit space regions 






64. Unit space regions necessary to 
fill bottom of space figure 
are counted 






o:>. Number of space regions which 

will fit up side of space figure 
estimated 






66. Number of layers multiplied by 
number of units in each layer, 
thus arriving at an estimate 
of number of unit space regions 
in the space figure 






67. Formula for obtaining volume of 
cube or rectangular prism: 
volume = area of base X height 






68. Formula for obtaining the 

volume of rectangular prism: 
volume » length X width X height 




1 1 * 


69. Formula for obtaining volume of 
a cube: 

Volume = length of side X length 
of side X length of side 






70. Class views various rectangular 
prisms and cubes and each student 
decides on volume of each by 
following the described procedures 
in numbers 63 through 66 
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Teacher Teacher Pupil (s) 

Gives Asks Responds 



71. Problems to solve using the 
formula i 

Volume « area of base X height 




1 




72. Problems in finding volunie of 

figures having other than square 
or rectangular bases 

1- o cioKcu to r xnu 
maximum and minimum volume of 
each 








73. Volume of each figure is estimated 








74. Other activity or classroom 
exercises 








75. Teacher reads reference material 
listed in manual. 


1 
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MATERIALS CHECKLIST 



Directions; 



Please take this checklist with you each time you visit the class- 
room. Check once if you find evidence of any of the materials in 

^u"" T"'^^^- ^^""^^ ^ 8"^P °f different 

Size bottles in the classroom, even if they are not used, you 
should place a check in the appropriate column, if you observe 
the teacher using additional instructional materials, related to 
the lesson, please describe these. 



First Second Third Fourth 

Observation Observation Observation Qh.<.Prv^f^nn 



1. Group of different 
size bottles 



2. 



Group of same sized 
jars, with caps. Jars 
should be filled with 
different fillers, e.g. 
beans, peas, sand, 
acrons, marbles, sweet- 
gum balls, etc. 



3. Empty jar, top and 
paper bag for each 
pair of students 



4» Worksheets (p. 223 
from Teacher Manual) 



5. Worksheets (p. 226 
from Teacher Manual) 



6» Ommiti Uf.HLrlliz :tu-/ ' 
additional materials 
teacher has prepared 
which are related to 
instructional objec- 
tives, (specify to 
which visit comment 
applies) 
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WCES . 20 



EDUCATIONAL TELEVISION QUESTIONNAIRE 



Office 
U»e Only 



pjnivertity of Georgia 



Georgia State Department of Education 



1-5 



CO 

CO 



o 
o 



9 

10-13 
14 

15 
16 

17 

Id 
19 

20-33 



34 



(Over 
Please) 



2. 



8. 



What is your Zip Code? (This is needed to assist in finding the viewing 
range for television stations in your area.) ' 

What is the age of the head of the household? 

_1. Under 25 _3. 35-49 _5. 65 and over 

_2. 25-34 _4. 50-64 

Please indicate the highest level of education reached by the head of the 

household? (Check the highest level reached,) 

_l. Grammar School, _4. Some G^Uege 

_2. Some High School _5. G>llege Graduate 

_3. High School Grad. or Equivalent _6. College Grad. plus additional work. 

Which of the following best describes the occuparton of the head of the 
household? 

1. Manual or unskilled labor, 

2. Service industries-barber, hairdresser, waiter, etc, 

3. Protective worker-policeman, fireman, guard, etc, 

4. Skilled worker- plumber, carpenter, machinist, etc. 

5. Foreman or supervisor. 

6. Clerical sales-salesman, sales clerk, secretary, etc, 

7. Owner or manager-office manager, own or manage business, department 

manager, etc. I 

8. Professional ^doctor, lawyer, teacher, etc. 

9. Retired. 

0. Other | 

How many people liye in your household? 

How many members of your household fall in each of the following age cateRories^ 
_1. Under 6 _2.|6-12 _3, 13-16 years _4. 17-20 years ca egories. 

1 

Do you live in a ^1. house you own? _4, apartment you rent? 

J.2. house you rent? 5. mobile home you own? 

J_3. apartment you own? _6. mobile home you rent? 

How many cars are owned by your household? . 



9. How many daily newspapers do you receive or purchase? 

_1. none _2. one _3. tWo _4. three _5. four of more 



10. 

11, 

12. 
13, 



14. 



How many magazines do you receive or purchase regularly each month? 
_1. none _2. one 3. two _U. three _5. four or raor^ 

How many black and white television iets do you have in your household? 

How many color television sets do you have in your household? 

How many hours jjould you estimate th« necihers of your household watch television 
in the average day? (Please give the total nambev of hours In each case.) 

Children under 6 hours Woman of the house hours 

Children age 6-12 hours Man of the house ^hours 

Teenagers age 13-16 ^hours Other adults hours 

Young adults age 17-20 hours 

What reason comes closest to your reason for watching television 
(Please check only one.) 

— 1. There is some beautiful art and music on television. 

_2. It is a way of getting an education; I learn something from television: 
3, It relaxes me. 

_4. It gives me an idea of how other people live, it is exciting 

~6* OtheJ''^* something to talk about with my friends, it gives me company. 
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For Office 
Utt Only 



35 



36 
37 



38-51 



52-76 



77 



78 



79 
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15. How do you go about picking the television program your family or you will watch? 
(Plaaie check only one.) 

1* turn the set on to one channel and leave it on that channel. 

_2. Turn the dial until we see a program that looks good. 

3* l^e same program every week» don*t make a decision with each program change. 

Talk it over with the other members of the household? 

_5. Station announcements. 

6. Consult TV Guide. 

7. Consult WCTV Program Guide. 

8. Consult newspaper. 

9. Other. 



16. Have you ever watched WCES, Channel 20? I. Yes 2. No (If you answered yes to 

this question, please skip to question number 18.) 

17. If you answered no to question 16, which of the following best describes your 
reason for not watching WCES, Channel 20? (Please check only one.) 

!• Poor reception * 3. Never heard of WCES, Channel 20? 

2. Don*t like the programs. 4. Other. 

IP YOU ANSWERED NO TO QUESTION 16 AND HAVE COMPLETED QUESTION 17, PI EASE STOP 
AND PUT THIS QUESTIONNAIRE IN THE SEIS ADDRESSED STAMPED ENVELOPE AND DROP IT 
IN YOUR NEAREST MAILBOX. THANK VOU FOR YOUR HELP AND COOPERATION IK OUR PROJECT. 

18. If you answered yes to question number 16, how many hours would you estimate 
the members of your household watch the public television that is on WCES 
Channel 20 in an average week? 

Woman of the house ^hours 

Man of the house hours 

Other adults hours 



Children under 6 hours 

Children age 6-12 hours 

Teenagers age 13-16 hours 

Young adults age 17-20 hours 



19. How often in the last month has any member of your household viewed any of the 
following television programs. (Please check one response for each program.) 

Not at all Regularly Irreau larlv 

52. Georgialand 

53. Sesame Street 

54. University News 

55. Bridge with Jean Cox 

56. Shavings (blumn 

57. Sound of Youth 

58. The Coach Uwson Show 

59. Black Journal 

60. NET Playhouse 

61. The McCUl lough Martin Show 

62. Firing Line (William Buckley) 

63. TV High School 

64. NET Journal > . 

65. French Chef (Julia Child) 
66.. The Forsytift Sa^a 

67. Mr. Rogers 

68. The advocates 

69. Aunt Lollipop 

70. Law Enforcement Training 

71. Why You Snoke 

72. Men and Ideas (Dr. William Hale) 

73. High and l/ild 

74. The American West 

75. Screen Classics 

76. (fovernment Story 

20. How did you first learn about WCES, Channel 20? (Please check only one.) 

• 1. Finding it on the set. 3. Heard about it from others. 

^2. Heard about it on television. 4. Read about it. 

5. Other 

21. What reason comes closest to your reason for watching WCES,Channel 20? 
_^1. There is some beautiful art and music on television. 

_2. It is a way of getting an education, I learn something from television. 
3. It relaxes me. 
„4. It gives me an idea of how other people live, it is exciting. 
_5. It gives me something to talk about with my friends. 
^6. Other. 

22. Have you talked to anyone (neighbor, acquaintance, friend) about something you 
taw on WCES, Channel 20 during the past week? _1. Yes _2. No 

IWANK YOU FOR TAKING TIME TO COMPLETE THIS QUESTIONNAIRE. PLEASE PUT THIS FORM 
IN THE SElf ADDRESSED STAMPED ENVELOPE AND DROP IT IN YOUR NEAREST MAILBOX. 

151 



1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


2. 


3. 


_1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


2. 


3. 


1. 


2. 


3. 


_1. 


2. 


3. 


1. 


_2. 


3. 


_1. 


_2. 


3. 


1. 


2. 


3. 


1. 


_2. 


3. 


r. 


_2. 


3. 


1. 


2. 


3. 


_i. 


2. 


3. 


1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


_2. 


3. 


1. 


2. 


3. 


1. 


2. 


3. 


1. 


2. 


3. 


1. 


2. 


_3. 


1. 


2. 


3. 



